Jun 25 18:00:46 devstack cinder-volume[82635]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 25 18:00:46 devstack cinder-volume[82635]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 18:00:46 devstack cinder-volume[82635]: we strongly recommend against using it for new projects. Jun 25 18:00:46 devstack cinder-volume[82635]: If you are already using Eventlet, we recommend migrating to a different Jun 25 18:00:46 devstack cinder-volume[82635]: framework. For more detail see Jun 25 18:00:46 devstack cinder-volume[82635]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 18:00:46 devstack cinder-volume[82635]: import eventlet # noqa Jun 25 18:00:49 devstack cinder-volume[82635]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:00:49 devstack cinder-volume[82635]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:00:49 devstack cinder-volume[82635]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:00:49 devstack cinder-volume[82635]: INFO dbcounter [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Registered counter for database cinder Jun 25 18:00:50 devstack cinder-volume[82635]: DEBUG oslo_db.sqlalchemy.engines [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82635) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:00:50 devstack cinder-volume[82635]: DEBUG dbcounter [-] [82635] Writer thread running {{(pid=82635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:00:50 devstack cinder-volume[82635]: INFO cinder.rpc [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 18:00:50 devstack cinder-volume[82635]: INFO cinder.rpc [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 18:00:50 devstack cinder-volume[82635]: DEBUG oslo_db.sqlalchemy.engines [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82635) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:00:50 devstack cinder-volume[82635]: INFO cinder.volume.manager [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Determined volume DB was empty at startup. Jun 25 18:00:50 devstack cinder-volume[82635]: DEBUG cinder.volume.manager [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82635) __init__ /opt/stack/cinder/cinder/volume/manager.py:304}} Jun 25 18:00:50 devstack cinder-volume[82635]: INFO cinder.volume.manager [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 25 18:00:50 devstack cinder-volume[82635]: WARNING stevedore.named [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 18:00:50 devstack cinder-volume[82635]: WARNING castellan.key_manager [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:00:50 devstack cinder-volume[82635]: WARNING cinder.keymgr.conf_key_mgr [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:00:50 devstack cinder-volume[82635]: DEBUG cinder.volume.drivers.lvm [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82635) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 25 18:00:50 devstack cinder-volume[82635]: DEBUG oslo_concurrency.processutils [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_concurrency.processutils [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] CMD "cinder-rtstool verify" returned: 0 in 0.700s {{(pid=82635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_db.sqlalchemy.engines [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82635) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:00:51 devstack cinder-volume[82635]: INFO cinder.rpc [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 25 18:00:51 devstack cinder-volume[82635]: INFO cinder.rpc [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version. Jun 25 18:00:51 devstack cinder-volume[82635]: WARNING stevedore.named [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 18:00:51 devstack cinder-volume[82635]: WARNING castellan.key_manager [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:00:51 devstack cinder-volume[82635]: INFO cinder.volume.manager [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_db.sqlalchemy.engines [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82635) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:00:51 devstack cinder-volume[82635]: INFO oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Starting 1 workers Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Started child 82813 {{(pid=82635) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Full set of CONF: {{(pid=82635) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] ******************************************************************************** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Configuration options gathered from: {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] ================================================================================ {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 25 18:00:51 devstack cinder-volume[82813]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] allow_availability_zone_fallback = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] allow_compression_on_image_upload = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] allowed_direct_url_schemes = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] api_rate_limit = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] auth_strategy = keystone {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] az_cache_duration = 3600 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_availability_zone = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_host = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_stats_polling_interval = 60 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backup_api_class = cinder.backup.api.API {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backup_name_template = backup-%s {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backup_use_same_host = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backup_use_temp_snapshot = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] chap_password = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] chap_username = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cinder_internal_tenant_project_id = bb39208158b24ab69dfa90b103cb62ea {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cinder_internal_tenant_user_id = c4b02cfb4927473aabc25020409cf99c {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cloned_volume_same_az = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cluster = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] compression_format = gzip {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] compute_api_class = cinder.compute.nova.API {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] config_dir = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] config_source = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] control_exchange = openstack {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] debug = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] default_availability_zone = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] default_group_type = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] default_volume_type = lvmdriver-1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] disk_geometry = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] driver_client_cert = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] driver_client_cert_key = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] driver_data_namespace = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] driver_ssl_cert_path = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] driver_ssl_cert_verify = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] driver_use_ssl = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] enable_force_upload = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] enable_new_services = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] enable_unsupported_driver = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] enabled_backends = ['lvmdriver-1'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] enforce_multipath_for_image_xfer = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] filter_function = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_api_insecure = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_api_servers = ['http://192.168.122.51/image'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_api_ssl_compression = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_ca_certificates_file = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_catalog_info = image:glance:publicURL {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_certfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_keyfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_num_retries = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance_request_timeout = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] goodness_function = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] graceful_shutdown_timeout = 5 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] group_api_class = cinder.group.api.API {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] host = devstack {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_compress_on_upload = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_conversion_address_space_limit = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_conversion_cpu_limit = 60 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_conversion_disable = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_upload_use_cinder_backend = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_upload_use_internal_tenant = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_volume_cache_enabled = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_volume_cache_max_count = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] image_volume_cache_max_size_gb = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] init_host_max_objects_retrieval = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] instance_format = [instance: %(uuid)s] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] iscsi_target_flags = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] iscsi_write_cache = on {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] iser_helper = tgtadm {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] iser_ip_address = 192.168.122.51 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] iser_port = 3260 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] log_color = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] log_config_append = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] log_dir = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] log_file = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] log_options = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] log_rotate_interval = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] log_rotate_interval_type = days {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] log_rotation_type = none {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] max_age = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] max_logfile_count = 30 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] max_logfile_size_mb = 200 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] max_over_subscription_ratio = 20.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] max_snapshots_per_migration = -1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] message_reap_interval = 86400 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] message_ttl = 2592000 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] migration_create_volume_timeout_secs = 300 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] monkey_patch = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] monkey_patch_modules = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] my_ip = 192.168.122.51 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] no_snapshot_gb_quota = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] num_iser_scan_tries = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] num_shell_tries = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] num_volume_device_scan_tries = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] nvmeof_conn_info_version = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] nvmet_ns_id = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] nvmet_port_id = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] osapi_max_limit = 1000 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] osapi_volume_ext_list = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] osapi_volume_listen = 0.0.0.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] osapi_volume_listen_port = 8776 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] osapi_volume_use_ssl = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] osapi_volume_workers = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] per_volume_size_limit = -1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] periodic_fuzzy_delay = 60 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] periodic_interval = 60 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] project_id_regex = [0-9a-f\-]+ {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] public_endpoint = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] publish_errors = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] quota_backup_gigabytes = 1000 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] quota_backups = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] quota_gigabytes = 1000 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] quota_groups = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] quota_snapshots = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] quota_volumes = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] rate_limit_burst = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] rate_limit_except_level = CRITICAL {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] rate_limit_interval = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] reinit_driver_count = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] replication_device = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] report_discard_supported = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] report_interval = 120 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] reservation_clean_interval = 86400 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] reservation_expire = 86400 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82813]: INFO cinder.volume.manager [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] reserved_image_namespaces = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] reserved_percentage = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] rpc_response_timeout = 120 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] run_external_periodic_tasks = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] scst_target_driver = iscsi {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] scst_target_iqn_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_down_time = 720 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] shell_completion = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] snapshot_name_template = snapshot-%s {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] snapshot_same_host = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] split_loggers = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] state_path = /opt/stack/data/cinder {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] storage_availability_zone = nova {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] storage_protocol = iSCSI {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] syslog_log_facility = LOG_USER {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] target_helper = lioadm {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] target_ip_address = 192.168.122.51 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] target_port = 3260 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] target_protocol = iscsi {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] target_secondary_ip_addresses = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] trace_flags = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] transfer_api_class = cinder.transfer.api.API {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] transport_url = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] until_refresh = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] use_chap_auth = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] use_default_quota_class = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] use_journal = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] use_json = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] use_multipath_for_image_xfer = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] use_stderr = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] use_syslog = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] verify_glance_signatures = enabled {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_api_class = cinder.volume.api.API {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_backend_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_clear = zero {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_clear_ionice = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_clear_size = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_copy_bps_limit = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_dd_blocksize = 1M {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_name_template = volume-%s {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_service_inithost_offload = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volume_usage_audit_period = month {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] zoning_mode = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_concurrency.disable_process_locking = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.auth_section = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.auth_type = password {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.auth_version = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.cache = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.certfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.delay_auth_decision = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.http_connect_timeout = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.include_service_catalog = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.insecure = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.interface = public {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.keyfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_password = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcache_username = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.region_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.service_token_roles_required = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.service_type = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.token_cache_time = 300 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.51/identity {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.backend = dogpile.cache.null {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.backend_argument = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.backend_expiration_time = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.config_prefix = cache.oslo {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.debug_cache_backend = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.enable_retry_client = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.enable_socket_keepalive = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.enabled = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.expiration_time = 600 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.hashclient_retry_attempts = 2 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.memcache_dead_retry = 300 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.memcache_pool_maxsize = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.memcache_sasl_enabled = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.password = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.proxies = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.redis_db = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.redis_sentinel_service_name = mymaster {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.redis_server = localhost:6379 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.retry_attempts = 2 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.retry_delay = 0.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.socket_keepalive_count = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.socket_keepalive_idle = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.socket_keepalive_interval = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.socket_timeout = 1.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.tls_allowed_ciphers = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.tls_cafile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.tls_certfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.tls_enabled = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.tls_keyfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cache.username = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] coordination.backend_url = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.asyncio_connection = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.asyncio_slave_connection = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.backend = sqlalchemy {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.connection = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.connection_debug = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.connection_parameters = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.connection_recycle_time = 3600 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.connection_trace = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.db_inc_retry_interval = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.db_max_retries = 20 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.db_max_retry_interval = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.db_retry_interval = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.max_overflow = 50 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.max_pool_size = 5 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.max_retries = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.mysql_wsrep_sync_wait = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.pool_timeout = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.retry_interval = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.slave_connection = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.sqlite_synchronous = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.synchronous_reader = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] database.use_db_reconnect = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.connection_string = messaging:// {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.enabled = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.es_doc_type = notification {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.es_scroll_size = 10000 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.es_scroll_time = 2m {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.filter_error_trace = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.hmac_keys = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.sentinel_service_name = mymaster {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.socket_timeout = 0.1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.trace_requests = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler.trace_sqlalchemy = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler_jaeger.process_tags = {} {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler_jaeger.service_name_prefix = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] profiler_otlp.service_name_prefix = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.enforce_new_defaults = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: WARNING oslo_config.cfg [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.enforce_scope = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.policy_default_rule = default {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.policy_file = policy.yaml {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_policy.remote_timeout = 60.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] privsep_osbrick.group = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] privsep_osbrick.helper_command = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] privsep_osbrick.user = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cinder_sys_admin.group = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cinder_sys_admin.helper_command = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] cinder_sys_admin.user = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.auth_section = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.auth_type = password {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.cafile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.certfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.collect_timing = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.insecure = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.keyfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.send_service_user_token = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.split_loggers = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] service_user.timeout = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.auth_section = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.auth_type = password {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.certfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.collect_timing = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.insecure = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.keyfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.region_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.split_loggers = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] glance.timeout = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack sudo[82821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.backend_availability_zone = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.chap_password = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.chap_username = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack sudo[82821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.disk_geometry = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.driver_client_cert = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.driver_client_cert_key = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.driver_data_namespace = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.driver_use_ssl = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.enable_unsupported_driver = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.extra_capabilities = {} {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.filter_function = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.goodness_function = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.iscsi_target_flags = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.iscsi_write_cache = on {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.iser_helper = tgtadm {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.iser_ip_address = 192.168.122.51 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.iser_port = 3260 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.lvm_mirrors = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.lvm_share_target = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.lvm_type = auto {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.num_shell_tries = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.nvmet_port_id = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.replication_device = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.report_discard_supported = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.reserved_percentage = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.scst_target_driver = iscsi {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.scst_target_iqn_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.storage_protocol = iSCSI {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.target_helper = tgtadm {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.target_ip_address = 192.168.122.51 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.target_port = 3260 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.target_protocol = iscsi {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.trace_flags = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.unique_fqdn_network = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.use_chap_auth = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volume_backend_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volume_clear = zero {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volume_clear_ionice = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volume_clear_size = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volume_group = cinder-volumes {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_reports.file_event_handler = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_reports.log_dir = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.backend_availability_zone = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.backend_host = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.chap_password = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.chap_username = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.chiscsi_conf = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.disk_geometry = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.driver_client_cert = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.driver_data_namespace = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.driver_use_ssl = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.extra_capabilities = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.filter_function = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.goodness_function = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.iser_helper = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.iser_ip_address = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.iser_port = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.iser_target_prefix = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.lvm_conf_file = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.lvm_mirrors = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.lvm_share_target = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.lvm_type = auto {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.num_shell_tries = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.nvmet_port_id = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.replication_device = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.report_discard_supported = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.reserved_percentage = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.scst_target_driver = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.storage_protocol = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.target_helper = lioadm {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.target_ip_address = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.target_port = 3260 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.target_protocol = iscsi {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.trace_flags = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.use_chap_auth = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volume_clear = zero {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volume_clear_size = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] lvmdriver-1.volumes_dir = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.ssl = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.ssl_version = {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_notifications.driver = [] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_notifications.retry = -1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] oslo_messaging_notifications.transport_url = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] key_manager.fixed_key = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.barbican_api_version = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.barbican_endpoint = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.barbican_endpoint_type = public {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.barbican_region_name = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.cafile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.certfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.collect_timing = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.insecure = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.keyfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.number_of_retries = 60 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.retry_delay = 1 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.send_service_user_token = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.split_loggers = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.timeout = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.verify_ssl = True {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican.verify_ssl_path = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican_service_user.auth_section = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican_service_user.auth_type = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican_service_user.cafile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican_service_user.certfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican_service_user.collect_timing = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican_service_user.insecure = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican_service_user.keyfile = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican_service_user.split_loggers = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] barbican_service_user.timeout = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.approle_role_id = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.approle_secret_id = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.kv_mountpoint = secret {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.kv_path = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.kv_version = 2 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.namespace = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.root_token_id = **** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.ssl_ca_crt_file = None {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.timeout = 60.0 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.use_ssl = False {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:00:51 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] ******************************************************************************** {{(pid=82635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 25 18:00:52 devstack sudo[82821]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:52 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.903s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:52 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:52 devstack sudo[83122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:00:52 devstack sudo[83122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:53 devstack sudo[83122]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:53 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.738s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:53 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:00:53 devstack cinder-volume[82813]: INFO cinder.brick.local_dev.lvm [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 25 18:00:53 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:53 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:53 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:53 devstack sudo[83375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:00:53 devstack sudo[83375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:54 devstack sudo[83375]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:54 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.745s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:54 devstack cinder-volume[82813]: DEBUG cinder.brick.local_dev.lvm [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82813) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 25 18:00:54 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:54 devstack sudo[83461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:00:54 devstack sudo[83461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:55 devstack sudo[83461]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:55 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.063s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:55 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:55 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:55 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:55 devstack sudo[83590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:00:55 devstack sudo[83590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:55 devstack sudo[83590]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:55 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.696s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:55 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:55 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:55 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:56 devstack sudo[83596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 25 18:00:56 devstack sudo[83596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:56 devstack sudo[83596]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:56 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.666s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:56 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:56 devstack sudo[83600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:00:56 devstack sudo[83600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:57 devstack sudo[83600]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:57 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.780s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:57 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:57 devstack sudo[83611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:00:57 devstack sudo[83611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:58 devstack sudo[83611]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:58 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.770s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:58 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:58 devstack sudo[83616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:00:58 devstack sudo[83616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:59 devstack sudo[83616]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:59 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.825s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:59 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:59 devstack sudo[83622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:00:59 devstack sudo[83622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:59 devstack sudo[83622]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:59 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.722s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:59 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:59 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:59 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:59 devstack sudo[83630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:00:59 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:00 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:00 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:00 devstack cinder-volume[82813]: INFO cinder.volume.drivers.lvm [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 25 18:01:00 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:00 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:00 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:00 devstack sudo[83639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:01:00 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:01 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:01 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.866s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:01 devstack cinder-volume[82813]: DEBUG cinder.volume.drivers.lvm [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Updating volume stats {{(pid=82813) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:01:01 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:01 devstack sudo[83757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:01:01 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:01 devstack cinder-volume[82635]: DEBUG dbcounter [-] [82635] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:01:02 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:02 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:02 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:02 devstack sudo[83853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:01:02 devstack sudo[83853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:02 devstack sudo[83853]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:02 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:02 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:02 devstack sudo[83903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:01:02 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:03 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:03 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.851s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:03 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:03 devstack sudo[83906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:01:03 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:04 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:04 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:04 devstack cinder-volume[82813]: INFO cinder.volume.driver [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Driver hasn't implemented _init_vendor_properties() Jun 25 18:01:04 devstack cinder-volume[82813]: DEBUG cinder.volume.driver [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82813) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 25 18:01:04 devstack cinder-volume[82813]: DEBUG oslo_db.sqlalchemy.engines [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82813) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:01:04 devstack cinder-volume[82813]: DEBUG dbcounter [-] [82813] Writer thread running {{(pid=82813) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:01:04 devstack cinder-volume[82813]: DEBUG cinder.db.api [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Building query based on filter {{(pid=82813) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 25 18:01:04 devstack cinder-volume[82813]: DEBUG cinder.image.image_utils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82813) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 25 18:01:04 devstack cinder-volume[82813]: INFO cinder.keymgr.migration [None req-0e932e41-9dbe-4038-9960-571fcacb9dd5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 18:01:04 devstack cinder-volume[82813]: DEBUG cinder.volume.drivers.lvm [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Updating volume stats {{(pid=82813) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:01:04 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:04 devstack sudo[83911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:01:04 devstack sudo[83911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:05 devstack sudo[83911]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:05 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:05 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:05 devstack sudo[83917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:01:05 devstack sudo[83917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:05 devstack sudo[83917]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:05 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:05 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:05 devstack sudo[83920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:01:05 devstack sudo[83920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:06 devstack sudo[83920]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:06 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:06 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:06 devstack sudo[83923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:01:06 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:07 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:07 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.777s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:07 devstack cinder-volume[82813]: DEBUG cinder.manager [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Notifying Schedulers of capabilities ... {{(pid=82813) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:01:07 devstack cinder-volume[82813]: INFO cinder.volume.manager [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Driver initialization completed successfully. Jun 25 18:01:07 devstack cinder-volume[82813]: INFO cinder.manager [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Initiating service 2 cleanup Jun 25 18:01:07 devstack cinder-volume[82813]: INFO cinder.manager [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Service 2 cleanup completed. Jun 25 18:01:07 devstack cinder-volume[82813]: DEBUG cinder.service [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Creating RPC server for service cinder-volume {{(pid=82813) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 18:01:07 devstack cinder-volume[82813]: DEBUG cinder.service [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82813) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 18:01:07 devstack cinder-volume[82813]: INFO cinder.volume.manager [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 25 18:01:07 devstack cinder-volume[82813]: DEBUG cinder.volume.drivers.lvm [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Updating volume stats {{(pid=82813) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:01:07 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:07 devstack sudo[83927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:01:07 devstack sudo[83927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:08 devstack sudo[83927]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:08 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:08 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:08 devstack sudo[83931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:01:08 devstack sudo[83931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:08 devstack sudo[83931]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:08 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:08 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:08 devstack sudo[83934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:01:08 devstack sudo[83934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:09 devstack sudo[83934]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:09 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:09 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:09 devstack sudo[83994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:01:09 devstack sudo[83994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:10 devstack sudo[83994]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:10 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:10 devstack cinder-volume[82813]: INFO cinder.volume.manager [None req-408001ef-40ba-4d13-94c1-debf34e753d3 None None] Driver post RPC initialization completed successfully. Jun 25 18:01:20 devstack cinder-volume[82813]: DEBUG dbcounter [-] [82813] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82813) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:01:20 devstack cinder-volume[82813]: DEBUG dbcounter [-] [82813] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82813) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:01:45 devstack cinder-volume[82813]: DEBUG oslo_service.periodic_task [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running periodic task VolumeManager._thread_info {{(pid=82813) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:01:45 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread count: 6 {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:01:45 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread info: [<_MainThread(MainThread, started 123562783359104)>, , , , , ] {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:02:45 devstack cinder-volume[82813]: DEBUG oslo_service.periodic_task [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82813) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:02:45 devstack cinder-volume[82813]: DEBUG cinder.volume.drivers.lvm [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Updating volume stats {{(pid=82813) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:02:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:02:45 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:02:45 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:02:45 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Jun 25 18:02:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:02:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:02:45 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:02:45 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:02:46 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Jun 25 18:02:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:02:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:02:46 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:02:46 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:02:47 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Jun 25 18:02:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:02:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:02:47 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:02:47 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:02:47 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Jun 25 18:02:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:02:47 devstack cinder-volume[82813]: DEBUG cinder.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Notifying Schedulers of capabilities ... {{(pid=82813) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:02:48 devstack cinder-volume[82813]: DEBUG oslo_service.periodic_task [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running periodic task VolumeManager._thread_info {{(pid=82813) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:02:48 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread count: 6 {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:02:48 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread info: [<_MainThread(MainThread, started 123562783359104)>, , , , , ] {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:03:20 devstack cinder-volume[82813]: DEBUG dbcounter [-] [82813] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82813) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:03:45 devstack cinder-volume[82813]: DEBUG oslo_service.periodic_task [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82813) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:03:45 devstack cinder-volume[82813]: DEBUG cinder.volume.drivers.lvm [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Updating volume stats {{(pid=82813) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:03:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:03:45 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:03:45 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:03:45 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Jun 25 18:03:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:03:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:03:45 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:03:45 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:03:46 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Jun 25 18:03:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:03:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:03:46 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:03:46 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:03:47 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Jun 25 18:03:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:03:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:03:47 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:03:47 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:03:47 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Jun 25 18:03:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:03:47 devstack cinder-volume[82813]: DEBUG cinder.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Notifying Schedulers of capabilities ... {{(pid=82813) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:03:47 devstack cinder-volume[82813]: DEBUG oslo_service.periodic_task [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running periodic task VolumeManager._thread_info {{(pid=82813) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:03:47 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread count: 6 {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:03:47 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread info: [<_MainThread(MainThread, started 123562783359104)>, , , , , ] {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:04:45 devstack cinder-volume[82813]: DEBUG oslo_service.periodic_task [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82813) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:04:45 devstack cinder-volume[82813]: DEBUG cinder.volume.drivers.lvm [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Updating volume stats {{(pid=82813) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:04:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:45 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:04:45 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:45 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:45 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:04:45 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:46 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:46 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:04:46 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:47 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:47 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:04:47 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:47 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:47 devstack cinder-volume[82813]: DEBUG cinder.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Notifying Schedulers of capabilities ... {{(pid=82813) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:04:47 devstack cinder-volume[82813]: DEBUG oslo_service.periodic_task [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running periodic task VolumeManager._thread_info {{(pid=82813) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:04:47 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread count: 6 {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:04:47 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread info: [<_MainThread(MainThread, started 123562783359104)>, , , , , ] {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:05:20 devstack cinder-volume[82813]: DEBUG dbcounter [-] [82813] Writing DB stats cinder:SELECT=1 {{(pid=82813) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:05:20 devstack cinder-volume[82813]: DEBUG dbcounter [-] [82813] Writing DB stats cinder:UPDATE=1 {{(pid=82813) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:05:45 devstack cinder-volume[82813]: DEBUG oslo_service.periodic_task [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82813) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:05:45 devstack cinder-volume[82813]: DEBUG cinder.volume.drivers.lvm [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Updating volume stats {{(pid=82813) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:05:45 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:05:45 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:05:45 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:05:46 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Jun 25 18:05:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:05:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:05:46 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:05:46 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:05:46 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Jun 25 18:05:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:05:46 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:05:46 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:05:46 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:05:47 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Jun 25 18:05:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:05:47 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:05:47 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:05:47 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:05:48 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Jun 25 18:05:48 devstack cinder-volume[82813]: DEBUG oslo_concurrency.processutils [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=82813) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:05:48 devstack cinder-volume[82813]: DEBUG cinder.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Notifying Schedulers of capabilities ... {{(pid=82813) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:05:48 devstack cinder-volume[82813]: DEBUG oslo_service.periodic_task [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] Running periodic task VolumeManager._thread_info {{(pid=82813) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:05:48 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread count: 6 {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:05:48 devstack cinder-volume[82813]: DEBUG cinder.volume.manager [None req-47192f00-74b9-4f6c-8b4c-8aedf91c5877 None None] thread info: [<_MainThread(MainThread, started 123562783359104)>, , , , , ] {{(pid=82813) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:06:13 devstack cinder-volume[82635]: INFO oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Caught SIGTERM, stopping children Jun 25 18:06:13 devstack cinder-volume[82635]: DEBUG oslo_concurrency.lockutils [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Acquiring lock "singleton_lock" {{(pid=82635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:06:13 devstack cinder-volume[82635]: DEBUG oslo_concurrency.lockutils [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Acquired lock "singleton_lock" {{(pid=82635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:06:13 devstack cinder-volume[82635]: DEBUG oslo_concurrency.lockutils [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Releasing lock "singleton_lock" {{(pid=82635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:06:13 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Stop services. {{(pid=82635) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 25 18:06:13 devstack cinder-volume[82635]: DEBUG oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Killing children. {{(pid=82635) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 25 18:06:13 devstack cinder-volume[82635]: INFO oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Waiting on 1 children to exit Jun 25 18:06:17 devstack cinder-volume[82813]: DEBUG oslo_concurrency.lockutils [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Acquiring lock "singleton_lock" {{(pid=82813) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:06:17 devstack cinder-volume[82813]: DEBUG oslo_concurrency.lockutils [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Acquired lock "singleton_lock" {{(pid=82813) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:06:17 devstack cinder-volume[82813]: DEBUG oslo_concurrency.lockutils [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Releasing lock "singleton_lock" {{(pid=82813) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:06:17 devstack cinder-volume[82813]: WARNING amqp [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 18:06:17 devstack cinder-volume[82813]: WARNING amqp [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 18:06:17 devstack cinder-volume[82635]: INFO oslo_service.backend._eventlet.service [None req-daa6813f-45e9-4a13-a45c-75bbd1a3b4eb None None] Child 82813 exited with status 0 Jun 25 18:06:17 devstack cinder-volume[92917]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 25 18:06:17 devstack cinder-volume[92917]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 18:06:17 devstack cinder-volume[92917]: we strongly recommend against using it for new projects. Jun 25 18:06:17 devstack cinder-volume[92917]: If you are already using Eventlet, we recommend migrating to a different Jun 25 18:06:17 devstack cinder-volume[92917]: framework. For more detail see Jun 25 18:06:17 devstack cinder-volume[92917]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 18:06:17 devstack cinder-volume[92917]: import eventlet # noqa Jun 25 18:06:20 devstack cinder-volume[92917]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92917) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:06:20 devstack cinder-volume[92917]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92917) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:06:20 devstack cinder-volume[92917]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92917) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:06:20 devstack cinder-volume[92917]: INFO dbcounter [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Registered counter for database cinder Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_db.sqlalchemy.engines [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92917) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG dbcounter [-] [92917] Writer thread running {{(pid=92917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:06:21 devstack cinder-volume[92917]: INFO cinder.rpc [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 18:06:21 devstack cinder-volume[92917]: INFO cinder.rpc [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_db.sqlalchemy.engines [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92917) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:06:21 devstack cinder-volume[92917]: INFO cinder.volume.manager [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Determined volume DB was empty at startup. Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG cinder.volume.manager [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92917) __init__ /opt/stack/cinder/cinder/volume/manager.py:304}} Jun 25 18:06:21 devstack cinder-volume[92917]: INFO cinder.volume.manager [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 25 18:06:21 devstack cinder-volume[92917]: WARNING stevedore.named [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 18:06:21 devstack cinder-volume[92917]: WARNING castellan.key_manager [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:06:21 devstack cinder-volume[92917]: WARNING cinder.keymgr.conf_key_mgr [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:06:21 devstack cinder-volume[92917]: INFO cinder.volume.manager [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_db.sqlalchemy.engines [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92917) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:06:21 devstack cinder-volume[92917]: INFO oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Starting 1 workers Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Started child 93130 {{(pid=92917) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Full set of CONF: {{(pid=92917) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] ******************************************************************************** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Configuration options gathered from: {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] ================================================================================ {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] allow_availability_zone_fallback = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] allow_compression_on_image_upload = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] allowed_direct_url_schemes = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] api_rate_limit = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] auth_strategy = keystone {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_availability_zone = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_host = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_stats_polling_interval = 60 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backup_api_class = cinder.backup.api.API {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[93130]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backup_name_template = backup-%s {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backup_use_same_host = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backup_use_temp_snapshot = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] chap_password = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] chap_username = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cinder_internal_tenant_project_id = bb39208158b24ab69dfa90b103cb62ea {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cinder_internal_tenant_user_id = c4b02cfb4927473aabc25020409cf99c {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cluster = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] compression_format = gzip {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] compute_api_class = cinder.compute.nova.API {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] config_dir = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] config_source = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] control_exchange = openstack {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] debug = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] default_availability_zone = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] default_group_type = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] default_volume_type = QuobyteHD {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] disk_geometry = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] driver_client_cert = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] driver_client_cert_key = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] driver_data_namespace = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] driver_ssl_cert_path = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] driver_ssl_cert_verify = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] driver_use_ssl = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] enable_new_services = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] enable_unsupported_driver = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] enabled_backends = ['QuobyteHD'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] enforce_multipath_for_image_xfer = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] filter_function = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_api_insecure = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_api_servers = ['http://192.168.122.51/image'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_api_ssl_compression = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_ca_certificates_file = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_catalog_info = image:glance:publicURL {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_certfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_keyfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_num_retries = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance_request_timeout = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] goodness_function = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] graceful_shutdown_timeout = 5 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] group_api_class = cinder.group.api.API {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] host = devstack {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_compress_on_upload = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_conversion_address_space_limit = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_conversion_cpu_limit = 60 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_conversion_disable = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_upload_use_cinder_backend = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_upload_use_internal_tenant = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_volume_cache_enabled = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_volume_cache_max_count = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] image_volume_cache_max_size_gb = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] init_host_max_objects_retrieval = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] instance_format = [instance: %(uuid)s] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] iscsi_target_flags = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] iscsi_write_cache = on {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] iser_helper = tgtadm {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] iser_ip_address = 192.168.122.51 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] iser_port = 3260 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] log_color = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] log_config_append = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] log_dir = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] log_file = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] log_options = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] log_rotate_interval = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] log_rotate_interval_type = days {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] log_rotation_type = none {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] max_age = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] max_logfile_count = 30 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] max_logfile_size_mb = 200 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] max_over_subscription_ratio = 20.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] message_reap_interval = 86400 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] message_ttl = 2592000 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] migration_create_volume_timeout_secs = 300 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] monkey_patch = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] monkey_patch_modules = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] my_ip = 192.168.122.51 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] no_snapshot_gb_quota = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] num_iser_scan_tries = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] num_shell_tries = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] num_volume_device_scan_tries = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] nvmeof_conn_info_version = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] nvmet_ns_id = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] nvmet_port_id = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] osapi_max_limit = 1000 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] osapi_volume_ext_list = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] osapi_volume_listen_port = 8776 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] osapi_volume_use_ssl = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] osapi_volume_workers = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] per_volume_size_limit = -1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] periodic_fuzzy_delay = 60 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] periodic_interval = 60 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] public_endpoint = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] publish_errors = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] quota_backup_gigabytes = 1000 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] quota_backups = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[93130]: INFO cinder.volume.manager [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Starting volume driver QuobyteDriver (1.1.14) Jun 25 18:06:21 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.remotefs [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93130) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] quota_gigabytes = 1000 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] quota_groups = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] quota_snapshots = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] quota_volumes = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] rate_limit_burst = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] rate_limit_except_level = CRITICAL {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] rate_limit_interval = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] reinit_driver_count = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] replication_device = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] report_discard_supported = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] report_interval = 120 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] reservation_clean_interval = 86400 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] reservation_expire = 86400 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] reserved_image_namespaces = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] reserved_percentage = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] rpc_response_timeout = 120 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] run_external_periodic_tasks = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] scst_target_driver = iscsi {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] scst_target_iqn_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_down_time = 720 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] shell_completion = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] snapshot_name_template = snapshot-%s {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] split_loggers = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] state_path = /opt/stack/data/cinder {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] storage_availability_zone = nova {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] storage_protocol = iSCSI {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] syslog_log_facility = LOG_USER {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] target_helper = lioadm {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] target_ip_address = 192.168.122.51 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] target_port = 3260 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] target_protocol = iscsi {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] target_secondary_ip_addresses = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] trace_flags = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] transport_url = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] until_refresh = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] use_chap_auth = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] use_default_quota_class = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] use_journal = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] use_json = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] use_multipath_for_image_xfer = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] use_stderr = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] use_syslog = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] verify_glance_signatures = enabled {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_api_class = cinder.volume.api.API {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_backend_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_clear = zero {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_clear_ionice = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_clear_size = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_copy_bps_limit = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_dd_blocksize = 1M {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_name_template = volume-%s {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_service_inithost_offload = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volume_usage_audit_period = month {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] zoning_mode = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_concurrency.disable_process_locking = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.auth_section = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.auth_type = password {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.auth_version = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.cache = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.certfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.include_service_catalog = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.insecure = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.interface = public {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.keyfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_password = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcache_username = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.region_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.service_type = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.51/identity {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.backend = dogpile.cache.null {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.backend_argument = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.backend_expiration_time = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.config_prefix = cache.oslo {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.debug_cache_backend = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.enable_retry_client = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.enable_socket_keepalive = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.enabled = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.expiration_time = 600 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.hashclient_retry_attempts = 2 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.memcache_dead_retry = 300 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.memcache_pool_maxsize = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.memcache_sasl_enabled = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.password = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.proxies = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.redis_db = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.redis_server = localhost:6379 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.retry_attempts = 2 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.retry_delay = 0.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.socket_keepalive_count = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.socket_keepalive_idle = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93130) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 25 18:06:21 devstack cinder-volume[93130]: WARNING cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.socket_keepalive_interval = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.socket_timeout = 1.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.tls_allowed_ciphers = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[93130]: WARNING cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.tls_cafile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.tls_certfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.tls_enabled = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.tls_keyfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cache.username = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Running cmd (subprocess): mount.quobyte {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] coordination.backend_url = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.asyncio_connection = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.asyncio_slave_connection = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.backend = sqlalchemy {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.connection = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.connection_debug = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.connection_parameters = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.connection_recycle_time = 3600 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.connection_trace = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.db_inc_retry_interval = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.db_max_retries = 20 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.db_max_retry_interval = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.db_retry_interval = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.max_overflow = 50 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.max_pool_size = 5 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.max_retries = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.mysql_wsrep_sync_wait = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.pool_timeout = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.retry_interval = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.slave_connection = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.sqlite_synchronous = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.synchronous_reader = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] database.use_db_reconnect = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.connection_string = messaging:// {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.enabled = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.es_doc_type = notification {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.es_scroll_size = 10000 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.es_scroll_time = 2m {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.filter_error_trace = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.hmac_keys = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.sentinel_service_name = mymaster {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.socket_timeout = 0.1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.trace_requests = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler.trace_sqlalchemy = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler_jaeger.process_tags = {} {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler_jaeger.service_name_prefix = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] profiler_otlp.service_name_prefix = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.enforce_new_defaults = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: WARNING oslo_config.cfg [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.enforce_scope = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.policy_default_rule = default {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.policy_file = policy.yaml {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] privsep_osbrick.group = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] privsep_osbrick.helper_command = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] privsep_osbrick.user = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cinder_sys_admin.group = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cinder_sys_admin.helper_command = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] cinder_sys_admin.user = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.auth_section = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.auth_type = password {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.cafile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.certfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.collect_timing = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.insecure = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.keyfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.send_service_user_token = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.split_loggers = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] service_user.timeout = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.auth_section = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.auth_type = password {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.certfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.collect_timing = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.insecure = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.keyfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.region_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.split_loggers = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] glance.timeout = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.backend_availability_zone = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.chap_password = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.chap_username = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.disk_geometry = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.driver_client_cert = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.driver_client_cert_key = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.driver_data_namespace = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.driver_use_ssl = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.extra_capabilities = {} {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.filter_function = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.goodness_function = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.iscsi_target_flags = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.iscsi_write_cache = on {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.iser_helper = tgtadm {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.iser_ip_address = 192.168.122.51 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.iser_port = 3260 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_host = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_login = admin {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_mount_options = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_password = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_private_key = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_share_path = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.num_shell_tries = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.quobyte_volume_url = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.replication_device = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.report_discard_supported = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.reserved_percentage = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.target_helper = tgtadm {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.target_ip_address = 192.168.122.51 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.target_port = 3260 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.target_protocol = iscsi {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.trace_flags = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.unique_fqdn_network = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.use_chap_auth = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.volume_backend_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.volume_clear = zero {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.volume_clear_ionice = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.volume_clear_size = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_reports.file_event_handler = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_reports.log_dir = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.backend_availability_zone = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.backend_host = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.chap_password = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.chap_username = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.chiscsi_conf = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.disk_geometry = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.driver_client_cert = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.driver_data_namespace = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.driver_use_ssl = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.extra_capabilities = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.filter_function = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.goodness_function = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.iser_helper = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.iser_ip_address = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.iser_port = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.iser_target_prefix = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_host = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_login = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_mount_options = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_password = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_private_key = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_share_path = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_ssh_port = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.num_shell_tries = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.nvmet_port_id = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.replication_device = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.report_discard_supported = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.reserved_percentage = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.scst_target_driver = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.storage_protocol = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.target_helper = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.target_ip_address = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack quobyte-client[93135]: Reading configuration file: /etc/quobyte/client.cfg Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.target_port = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack quobyte-client[93135]: Invalid parameters found, error: missing mount point. Jun 25 18:06:21 devstack quobyte-client[93135]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 25 18:06:21 devstack quobyte-client[93135]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.target_prefix = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.target_protocol = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.trace_flags = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.use_chap_auth = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.volume_clear = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93130) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.volume_clear_size = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] QuobyteHD.volumes_dir = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[93130]: INFO cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca ... Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 -c /etc/quobyte/client-cinder.cfg {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.ssl = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_notifications.driver = [] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_notifications.retry = -1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] key_manager.fixed_key = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.barbican_api_version = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.barbican_endpoint = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.barbican_endpoint_type = public {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.barbican_region_name = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.cafile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.certfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.collect_timing = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.insecure = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.keyfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.number_of_retries = 60 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.retry_delay = 1 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.send_service_user_token = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.split_loggers = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.timeout = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.verify_ssl = True {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican.verify_ssl_path = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican_service_user.auth_section = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican_service_user.auth_type = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican_service_user.cafile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican_service_user.certfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican_service_user.collect_timing = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican_service_user.insecure = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican_service_user.keyfile = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican_service_user.split_loggers = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] barbican_service_user.timeout = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.approle_role_id = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.approle_secret_id = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.kv_mountpoint = secret {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.kv_path = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.kv_version = 2 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.namespace = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.root_token_id = **** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.ssl_ca_crt_file = None {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.timeout = 60.0 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.use_ssl = False {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:21 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] ******************************************************************************** {{(pid=92917) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 25 18:06:21 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 -c /etc/quobyte/client-cinder.cfg Jun 25 18:06:21 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:22 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:22 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.831s {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:22 devstack cinder-volume[93130]: INFO cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca succeeded Jun 25 18:06:22 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93130) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:22 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.848s {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:22 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:22 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:06:22 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:23 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.653s {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:23 devstack cinder-volume[93130]: INFO cinder.volume.driver [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Driver hasn't implemented _init_vendor_properties() Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG cinder.volume.driver [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6699256896973, 'free_capacity_gb': 1775.6699256896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93130) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG oslo_db.sqlalchemy.engines [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG dbcounter [-] [93130] Writer thread running {{(pid=93130) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG cinder.db.api [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Building query based on filter {{(pid=93130) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG cinder.image.image_utils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93130) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 25 18:06:23 devstack cinder-volume[93130]: INFO cinder.keymgr.migration [None req-0165b5a4-b40e-4d7c-b0f2-175e0fe7fd7e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93130) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93130) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:23 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:23 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:06:23 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:24 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.705s {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG cinder.manager [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Notifying Schedulers of capabilities ... {{(pid=93130) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:06:24 devstack cinder-volume[93130]: INFO cinder.volume.manager [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Driver initialization completed successfully. Jun 25 18:06:24 devstack cinder-volume[93130]: INFO cinder.manager [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Initiating service 3 cleanup Jun 25 18:06:24 devstack cinder-volume[93130]: INFO cinder.manager [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Service 3 cleanup completed. Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG cinder.service [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Creating RPC server for service cinder-volume {{(pid=93130) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG cinder.service [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93130) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 18:06:24 devstack cinder-volume[93130]: INFO cinder.volume.manager [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93130) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93130) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:24 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:24 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:06:24 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:25 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:25 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.804s {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:25 devstack cinder-volume[93130]: INFO cinder.volume.manager [None req-fd5c23ad-bfef-4241-905f-0713b44c1dde None None] Driver post RPC initialization completed successfully. Jun 25 18:06:29 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-26a4531d-a840-4ea2-ad38-e07f21783142 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:29 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-26a4531d-a840-4ea2-ad38-e07f21783142 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:29 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.quobyte [None req-26a4531d-a840-4ea2-ad38-e07f21783142 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93130) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:29 devstack cinder-volume[93130]: DEBUG cinder.volume.drivers.quobyte [None req-26a4531d-a840-4ea2-ad38-e07f21783142 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93130) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:29 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-26a4531d-a840-4ea2-ad38-e07f21783142 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93130) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:29 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-26a4531d-a840-4ea2-ad38-e07f21783142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:29 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:06:29 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:29 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:29 devstack cinder-volume[93130]: DEBUG oslo_concurrency.processutils [None req-26a4531d-a840-4ea2-ad38-e07f21783142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.604s {{(pid=93130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:29 devstack cinder-volume[93130]: DEBUG cinder.manager [None req-26a4531d-a840-4ea2-ad38-e07f21783142 None None] Notifying Schedulers of capabilities ... {{(pid=93130) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:06:31 devstack cinder-volume[92917]: DEBUG dbcounter [-] [92917] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:06:32 devstack cinder-volume[92917]: INFO oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Caught SIGTERM, stopping children Jun 25 18:06:32 devstack cinder-volume[92917]: DEBUG oslo_concurrency.lockutils [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Acquiring lock "singleton_lock" {{(pid=92917) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:06:32 devstack cinder-volume[92917]: DEBUG oslo_concurrency.lockutils [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Acquired lock "singleton_lock" {{(pid=92917) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:06:32 devstack cinder-volume[92917]: DEBUG oslo_concurrency.lockutils [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Releasing lock "singleton_lock" {{(pid=92917) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:06:32 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Stop services. {{(pid=92917) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 25 18:06:32 devstack cinder-volume[92917]: DEBUG oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Killing children. {{(pid=92917) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 25 18:06:32 devstack cinder-volume[92917]: INFO oslo_service.backend._eventlet.service [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Waiting on 1 children to exit Jun 25 18:06:35 devstack cinder-volume[93130]: DEBUG dbcounter [-] [93130] Writing DB stats cinder:SELECT=2 {{(pid=93130) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:06:35 devstack cinder-volume[93130]: DEBUG dbcounter [-] [93130] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93130) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:06:37 devstack cinder-volume[93130]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 25 18:06:37 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Acquiring lock "singleton_lock" {{(pid=93130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:06:37 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Acquired lock "singleton_lock" {{(pid=93130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:06:37 devstack cinder-volume[93130]: DEBUG oslo_concurrency.lockutils [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Releasing lock "singleton_lock" {{(pid=93130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:06:37 devstack cinder-volume[93130]: WARNING amqp [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 18:06:37 devstack cinder-volume[93130]: WARNING amqp [None req-505e01f3-6a81-4666-b92a-a891037d82f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 18:06:38 devstack cinder-volume[93477]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 25 18:06:38 devstack cinder-volume[93477]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 18:06:38 devstack cinder-volume[93477]: we strongly recommend against using it for new projects. Jun 25 18:06:38 devstack cinder-volume[93477]: If you are already using Eventlet, we recommend migrating to a different Jun 25 18:06:38 devstack cinder-volume[93477]: framework. For more detail see Jun 25 18:06:38 devstack cinder-volume[93477]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 18:06:38 devstack cinder-volume[93477]: import eventlet # noqa Jun 25 18:06:40 devstack cinder-volume[93477]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93477) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:06:40 devstack cinder-volume[93477]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93477) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:06:40 devstack cinder-volume[93477]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93477) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:06:41 devstack cinder-volume[93477]: INFO dbcounter [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Registered counter for database cinder Jun 25 18:06:41 devstack cinder-volume[93477]: DEBUG oslo_db.sqlalchemy.engines [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93477) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:06:41 devstack cinder-volume[93477]: DEBUG dbcounter [-] [93477] Writer thread running {{(pid=93477) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:06:41 devstack cinder-volume[93477]: INFO cinder.rpc [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 18:06:41 devstack cinder-volume[93477]: INFO cinder.rpc [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 18:06:41 devstack cinder-volume[93477]: DEBUG oslo_db.sqlalchemy.engines [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93477) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:06:41 devstack cinder-volume[93477]: INFO cinder.volume.manager [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Determined volume DB was empty at startup. Jun 25 18:06:41 devstack cinder-volume[93477]: DEBUG cinder.volume.manager [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93477) __init__ /opt/stack/cinder/cinder/volume/manager.py:304}} Jun 25 18:06:41 devstack cinder-volume[93477]: WARNING stevedore.named [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 18:06:41 devstack cinder-volume[93477]: WARNING castellan.key_manager [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:06:41 devstack cinder-volume[93477]: WARNING cinder.keymgr.conf_key_mgr [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:06:41 devstack cinder-volume[93477]: INFO cinder.volume.manager [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 25 18:06:41 devstack cinder-volume[93477]: DEBUG oslo_db.sqlalchemy.engines [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93477) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:06:42 devstack cinder-volume[93477]: INFO oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Starting 1 workers Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Started child 93767 {{(pid=93477) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Full set of CONF: {{(pid=93477) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] ******************************************************************************** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Configuration options gathered from: {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] ================================================================================ {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] allow_availability_zone_fallback = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] allow_compression_on_image_upload = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] allowed_direct_url_schemes = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93767]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] api_rate_limit = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] auth_strategy = keystone {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_availability_zone = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_host = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_stats_polling_interval = 60 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backup_api_class = cinder.backup.api.API {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backup_name_template = backup-%s {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backup_use_same_host = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backup_use_temp_snapshot = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] chap_password = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] chap_username = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cinder_internal_tenant_project_id = bb39208158b24ab69dfa90b103cb62ea {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cinder_internal_tenant_user_id = c4b02cfb4927473aabc25020409cf99c {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cluster = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] compression_format = gzip {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] compute_api_class = cinder.compute.nova.API {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] config_dir = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] config_source = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] control_exchange = openstack {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] debug = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] default_availability_zone = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] default_group_type = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] default_volume_type = QuobyteHD {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] disk_geometry = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] driver_client_cert = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] driver_client_cert_key = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] driver_data_namespace = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] driver_ssl_cert_path = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] driver_ssl_cert_verify = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] driver_use_ssl = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] enable_new_services = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] enable_unsupported_driver = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] enabled_backends = ['QuobyteHD'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] enforce_multipath_for_image_xfer = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] filter_function = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_api_insecure = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_api_servers = ['http://192.168.122.51/image'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_api_ssl_compression = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_ca_certificates_file = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_catalog_info = image:glance:publicURL {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_certfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_keyfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_num_retries = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance_request_timeout = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] goodness_function = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] graceful_shutdown_timeout = 5 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] group_api_class = cinder.group.api.API {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] host = devstack {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_compress_on_upload = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_conversion_address_space_limit = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_conversion_cpu_limit = 60 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_conversion_disable = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_upload_use_cinder_backend = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_upload_use_internal_tenant = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_volume_cache_enabled = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_volume_cache_max_count = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] image_volume_cache_max_size_gb = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] init_host_max_objects_retrieval = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] instance_format = [instance: %(uuid)s] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] iscsi_target_flags = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] iscsi_write_cache = on {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] iser_helper = tgtadm {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] iser_ip_address = 192.168.122.51 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] iser_port = 3260 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] log_color = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] log_config_append = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] log_dir = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93767) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] log_file = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] log_options = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] log_rotate_interval = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] log_rotate_interval_type = days {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] log_rotation_type = none {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] max_age = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] max_logfile_count = 30 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] max_logfile_size_mb = 200 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] max_over_subscription_ratio = 20.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] message_reap_interval = 86400 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] message_ttl = 2592000 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] migration_create_volume_timeout_secs = 300 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] monkey_patch = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] monkey_patch_modules = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] my_ip = 192.168.122.51 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] no_snapshot_gb_quota = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] num_iser_scan_tries = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] num_shell_tries = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] num_volume_device_scan_tries = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] nvmeof_conn_info_version = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] nvmet_ns_id = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] nvmet_port_id = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] osapi_max_limit = 1000 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] osapi_volume_ext_list = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] osapi_volume_listen = 0.0.0.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] osapi_volume_listen_port = 8776 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] osapi_volume_use_ssl = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] osapi_volume_workers = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] per_volume_size_limit = -1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] periodic_fuzzy_delay = 60 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] periodic_interval = 60 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] project_id_regex = [0-9a-f\-]+ {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] public_endpoint = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] publish_errors = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] quota_backup_gigabytes = 1000 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] quota_backups = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] quota_gigabytes = 1000 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] quota_groups = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] quota_snapshots = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] quota_volumes = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] rate_limit_burst = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] rate_limit_except_level = CRITICAL {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] rate_limit_interval = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] reinit_driver_count = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] replication_device = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] report_discard_supported = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] report_interval = 120 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] reservation_clean_interval = 86400 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] reservation_expire = 86400 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] reserved_image_namespaces = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] reserved_percentage = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] rpc_response_timeout = 120 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] run_external_periodic_tasks = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] scst_target_driver = iscsi {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] scst_target_iqn_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_down_time = 720 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] shell_completion = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] snapshot_name_template = snapshot-%s {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] split_loggers = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] state_path = /opt/stack/data/cinder {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] storage_availability_zone = nova {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] storage_protocol = iSCSI {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] syslog_log_facility = LOG_USER {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] target_helper = lioadm {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] target_ip_address = 192.168.122.51 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] target_port = 3260 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] target_protocol = iscsi {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] target_secondary_ip_addresses = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] trace_flags = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] transfer_api_class = cinder.transfer.api.API {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] transport_url = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] until_refresh = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] use_chap_auth = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] use_default_quota_class = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] use_journal = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] use_json = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] use_multipath_for_image_xfer = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] use_stderr = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] use_syslog = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] verify_glance_signatures = enabled {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_api_class = cinder.volume.api.API {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_backend_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_clear = zero {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_clear_ionice = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_clear_size = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_copy_bps_limit = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_dd_blocksize = 1M {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_name_template = volume-%s {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_service_inithost_offload = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volume_usage_audit_period = month {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] zoning_mode = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_concurrency.disable_process_locking = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.auth_section = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.auth_type = password {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.auth_version = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.cache = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.certfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.delay_auth_decision = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.http_connect_timeout = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.include_service_catalog = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.insecure = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.interface = public {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.keyfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_password = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcache_username = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93767) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 25 18:06:42 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.quobyte [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 25 18:06:42 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.quobyte [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Running cmd (subprocess): mount.quobyte {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.region_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.service_token_roles_required = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.service_type = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.token_cache_time = 300 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.51/identity {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.backend = dogpile.cache.null {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.backend_argument = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.backend_expiration_time = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.config_prefix = cache.oslo {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.debug_cache_backend = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.enable_retry_client = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.enable_socket_keepalive = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.enabled = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.expiration_time = 600 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.hashclient_retry_attempts = 2 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.memcache_dead_retry = 300 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.memcache_pool_maxsize = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.memcache_sasl_enabled = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.password = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.proxies = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.redis_db = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.redis_sentinel_service_name = mymaster {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.redis_server = localhost:6379 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.retry_attempts = 2 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.retry_delay = 0.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.socket_keepalive_count = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.socket_keepalive_idle = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.socket_keepalive_interval = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.socket_timeout = 1.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.tls_allowed_ciphers = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.tls_cafile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.tls_certfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.tls_enabled = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.tls_keyfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cache.username = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] coordination.backend_url = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.asyncio_connection = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.asyncio_slave_connection = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.backend = sqlalchemy {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.connection = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.connection_debug = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.connection_parameters = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.connection_recycle_time = 3600 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.connection_trace = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.db_inc_retry_interval = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.db_max_retries = 20 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.db_max_retry_interval = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.db_retry_interval = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.max_overflow = 50 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.max_pool_size = 5 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.max_retries = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.mysql_wsrep_sync_wait = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.pool_timeout = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.retry_interval = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.slave_connection = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.sqlite_synchronous = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.synchronous_reader = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] database.use_db_reconnect = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.connection_string = messaging:// {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.enabled = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.es_doc_type = notification {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.es_scroll_size = 10000 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.es_scroll_time = 2m {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.filter_error_trace = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.hmac_keys = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.sentinel_service_name = mymaster {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.socket_timeout = 0.1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.trace_requests = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack quobyte-client[93781]: Reading configuration file: /etc/quobyte/client.cfg Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler.trace_sqlalchemy = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler_jaeger.process_tags = {} {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler_jaeger.service_name_prefix = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] profiler_otlp.service_name_prefix = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.enforce_new_defaults = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: WARNING oslo_config.cfg [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 25 18:06:42 devstack quobyte-client[93781]: Invalid parameters found, error: missing mount point. Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.enforce_scope = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.policy_default_rule = default {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.policy_file = policy.yaml {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack quobyte-client[93781]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_policy.remote_timeout = 60.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] privsep_osbrick.group = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] privsep_osbrick.helper_command = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack quobyte-client[93781]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] privsep_osbrick.user = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cinder_sys_admin.group = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cinder_sys_admin.helper_command = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] cinder_sys_admin.user = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.auth_section = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.auth_type = password {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.cafile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.certfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.collect_timing = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.insecure = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.keyfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.send_service_user_token = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.split_loggers = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] service_user.timeout = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.auth_section = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.auth_type = password {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.certfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.collect_timing = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.insecure = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.keyfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.region_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.split_loggers = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] glance.timeout = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.backend_availability_zone = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.chap_password = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.chap_username = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.disk_geometry = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.driver_client_cert = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.driver_client_cert_key = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.driver_data_namespace = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.driver_use_ssl = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.enable_unsupported_driver = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.extra_capabilities = {} {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.filter_function = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.goodness_function = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.iscsi_target_flags = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.iscsi_write_cache = on {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.iser_helper = tgtadm {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.iser_ip_address = 192.168.122.51 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.iser_port = 3260 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_host = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_login = admin {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_mount_options = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_password = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_private_key = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_share_path = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_ssh_port = 22 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.num_shell_tries = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.nvmet_port_id = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.quobyte_client_cfg = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.quobyte_volume_url = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.replication_device = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.report_discard_supported = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.reserved_percentage = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.scst_target_driver = iscsi {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.scst_target_iqn_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.storage_protocol = iSCSI {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.target_helper = tgtadm {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.target_ip_address = 192.168.122.51 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.target_port = 3260 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.target_protocol = iscsi {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.trace_flags = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.unique_fqdn_network = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.use_chap_auth = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.volume_backend_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.volume_clear = zero {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.volume_clear_ionice = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.volume_clear_size = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_reports.file_event_handler = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_reports.log_dir = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.backend_availability_zone = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.backend_host = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.chap_password = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.chap_username = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.chiscsi_conf = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.disk_geometry = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.driver_client_cert = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.driver_client_cert_key = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.driver_data_namespace = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.driver_use_ssl = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.extra_capabilities = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.filter_function = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.goodness_function = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.iscsi_target_flags = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.iscsi_write_cache = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.iser_helper = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.iser_ip_address = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.iser_port = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.iser_target_prefix = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_host = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_login = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_mount_options = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_password = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_private_key = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_share_path = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_ssh_port = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.num_shell_tries = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nvmet_ns_id = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.nvmet_port_id = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.replication_device = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.report_discard_supported = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.reserved_percentage = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.scst_target_driver = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.storage_protocol = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.target_helper = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.target_ip_address = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.target_port = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.target_prefix = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.target_protocol = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.trace_flags = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.unique_fqdn_network = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.use_chap_auth = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.volume_clear = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.volume_clear_ionice = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.volume_clear_size = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] QuobyteHD.volumes_dir = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.ssl = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.ssl_version = {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_notifications.driver = [] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_notifications.retry = -1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] oslo_messaging_notifications.transport_url = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] key_manager.fixed_key = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.barbican_api_version = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.barbican_endpoint = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.barbican_endpoint_type = public {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.barbican_region_name = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.cafile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.certfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.collect_timing = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.insecure = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.keyfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.number_of_retries = 60 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.retry_delay = 1 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.send_service_user_token = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.split_loggers = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.timeout = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.verify_ssl = True {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican.verify_ssl_path = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican_service_user.auth_section = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican_service_user.auth_type = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican_service_user.cafile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican_service_user.certfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican_service_user.collect_timing = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican_service_user.insecure = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican_service_user.keyfile = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican_service_user.split_loggers = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] barbican_service_user.timeout = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.approle_role_id = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.approle_secret_id = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.kv_mountpoint = secret {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.kv_path = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.kv_version = 2 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.namespace = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.root_token_id = **** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.ssl_ca_crt_file = None {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.timeout = 60.0 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.use_ssl = False {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:06:42 devstack cinder-volume[93477]: DEBUG oslo_service.backend._eventlet.service [None req-cac1cbf0-7756-4fd1-ba37-4acb415a754e None None] ******************************************************************************** {{(pid=93477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 25 18:06:42 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.620s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:42 devstack cinder-volume[93767]: INFO cinder.volume.driver [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Driver hasn't implemented _init_vendor_properties() Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG cinder.volume.driver [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6699256896973, 'free_capacity_gb': 1775.6699256896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93767) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG oslo_db.sqlalchemy.engines [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93767) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writer thread running {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:06:42 devstack cinder-volume[93767]: DEBUG cinder.db.api [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Building query based on filter {{(pid=93767) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93767) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:43 devstack cinder-volume[93767]: INFO cinder.keymgr.migration [None req-b81803b6-b74b-4adb-9f63-992167a51777 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 18:06:43 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:06:43 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:43 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.649s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:06:43 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Driver initialization completed successfully. Jun 25 18:06:43 devstack cinder-volume[93767]: INFO cinder.manager [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Initiating service 3 cleanup Jun 25 18:06:43 devstack cinder-volume[93767]: INFO cinder.manager [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Service 3 cleanup completed. Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG cinder.service [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Creating RPC server for service cinder-volume {{(pid=93767) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG cinder.service [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93767) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 18:06:43 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:43 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:06:43 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:44 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.640s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d314fb78-ba96-4f3a-a6e6-6824881fa9c1 None None] Driver post RPC initialization completed successfully. Jun 25 18:06:52 devstack cinder-volume[93477]: DEBUG dbcounter [-] [93477] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93477) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:06:53 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=2 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:06:54 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:07:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:07:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 6 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:07:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Flow 'volume_create_manager' (22823112-b4b4-4683-b504-175c61f57f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b840ca4-7dee-4486-9a32-4fd1b5d2db94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b840ca4-7dee-4486-9a32-4fd1b5d2db94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-842611867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5b8921-df36-4e64-b2f4-32881e6aac0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f7e3a7c143846afa28af665b68fe960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:41Z,use_quota=True,user_id='5e10dadd70a647d5bdf1707a9723c8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38d60c5-e342-4e3c-afab-50f1ff62a812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38d60c5-e342-4e3c-afab-50f1ff62a812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088bb7ff-30ed-422f-8bda-9c60ec51498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088bb7ff-30ed-422f-8bda-9c60ec51498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5b8921-df36-4e64-b2f4-32881e6aac0f', 'volume_name': 'volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3515c729-0747-4dba-ba33-a6f30025a064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3515c729-0747-4dba-ba33-a6f30025a064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78772fa1-b189-4dc0-b7be-33db0d9d2500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:41 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Volume 8c5b8921-df36-4e64-b2f4-32881e6aac0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f', 'volume_size': 1} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-842611867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5b8921-df36-4e64-b2f4-32881e6aac0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f7e3a7c143846afa28af665b68fe960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:41Z,use_quota=True,user_id='5e10dadd70a647d5bdf1707a9723c8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Creating volume 8c5b8921-df36-4e64-b2f4-32881e6aac0f {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:07:41 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:07:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:41 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f 1073741824 Jun 25 18:07:41 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:42 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f 1073741824" returned: 0 in 1.725s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:43 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f Jun 25 18:07:43 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:44 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f" returned: 0 in 1.317s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] <== create_volume: return (3118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:07:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.121s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78772fa1-b189-4dc0-b7be-33db0d9d2500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a338958f-7a7c-4d3b-8c9c-01f8176a1170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:44 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Volume volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f (8c5b8921-df36-4e64-b2f4-32881e6aac0f): created successfully Jun 25 18:07:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a338958f-7a7c-4d3b-8c9c-01f8176a1170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Flow 'volume_create_manager' (22823112-b4b4-4683-b504-175c61f57f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f8aea7bc-3305-4624-8e30-6e85a31bfd45 tempest-VolumesTestJSON-231148243 None] Created volume successfully. Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Flow 'volume_create_manager' (36a02fec-7571-41c1-8319-d5b31512ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cea259-bf0b-477a-a355-640022aa98f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cea259-bf0b-477a-a355-640022aa98f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1157721145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e61f853-7067-4f2b-bef1-0d966632a557,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f7e3a7c143846afa28af665b68fe960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:46Z,use_quota=True,user_id='5e10dadd70a647d5bdf1707a9723c8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4478add-4ee8-4921-8b67-2ee130ea3d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4478add-4ee8-4921-8b67-2ee130ea3d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba27abb-3055-4c6c-92a8-9ae9617d7ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba27abb-3055-4c6c-92a8-9ae9617d7ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e61f853-7067-4f2b-bef1-0d966632a557', 'volume_name': 'volume-8e61f853-7067-4f2b-bef1-0d966632a557', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76bf291-37f3-47e7-ad38-5f22fc4d8fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76bf291-37f3-47e7-ad38-5f22fc4d8fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81937202-d62c-4e68-819e-bfb4db966421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:46 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Volume 8e61f853-7067-4f2b-bef1-0d966632a557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e61f853-7067-4f2b-bef1-0d966632a557', 'volume_size': 1} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1157721145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e61f853-7067-4f2b-bef1-0d966632a557,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f7e3a7c143846afa28af665b68fe960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:46Z,use_quota=True,user_id='5e10dadd70a647d5bdf1707a9723c8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Creating volume 8e61f853-7067-4f2b-bef1-0d966632a557 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:07:46 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:07:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:46 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557 1073741824 Jun 25 18:07:46 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557 1073741824" returned: 0 in 1.543s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:47 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:47 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557 Jun 25 18:07:47 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:48 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557" returned: 0 in 1.054s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] <== create_volume: return (2693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:07:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.696s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81937202-d62c-4e68-819e-bfb4db966421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e61f853-7067-4f2b-bef1-0d966632a557', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467fe076-4ef3-44cf-85bb-9fc66fd2bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:49 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Volume volume-8e61f853-7067-4f2b-bef1-0d966632a557 (8e61f853-7067-4f2b-bef1-0d966632a557): created successfully Jun 25 18:07:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467fe076-4ef3-44cf-85bb-9fc66fd2bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Flow 'volume_create_manager' (36a02fec-7571-41c1-8319-d5b31512ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:49 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-441c6846-adcf-48ac-9198-6e4464fac812 tempest-VolumesTestJSON-231148243 None] Created volume successfully. Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Flow 'volume_create_manager' (605948c2-da30-4748-976c-4b5e113b7b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c71c9a-1398-49a6-a085-245033ff55b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c71c9a-1398-49a6-a085-245033ff55b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1570381248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c11b3c-f94b-4048-bedc-1c173b5c8d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941a5df85e774280ad42f2cd1178cbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:50Z,use_quota=True,user_id='2beecefd5cbc4332b16e398723c523bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820dfae7-bd8d-42e3-8b25-98450e988529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820dfae7-bd8d-42e3-8b25-98450e988529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35742864-fd25-4879-8b46-9b4569776707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35742864-fd25-4879-8b46-9b4569776707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c11b3c-f94b-4048-bedc-1c173b5c8d54', 'volume_name': 'volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7635aa68-361e-4912-92cf-f5f91165906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7635aa68-361e-4912-92cf-f5f91165906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df240c5a-9309-4e5a-8dff-deacf7f2efea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:50 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Volume e8c11b3c-f94b-4048-bedc-1c173b5c8d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54', 'volume_size': 1} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1570381248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c11b3c-f94b-4048-bedc-1c173b5c8d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941a5df85e774280ad42f2cd1178cbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:50Z,use_quota=True,user_id='2beecefd5cbc4332b16e398723c523bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Creating volume e8c11b3c-f94b-4048-bedc-1c173b5c8d54 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:07:50 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:50 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 1073741824 Jun 25 18:07:50 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Flow 'volume_create_manager' (47620dab-a3b8-4602-a305-755b7239e491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8983db33-4af5-4490-a699-fda97b18bd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8983db33-4af5-4490-a699-fda97b18bd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-88438680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c85e490-d966-4571-a12b-d63d286b6b5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f7e3a7c143846afa28af665b68fe960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:51Z,use_quota=True,user_id='5e10dadd70a647d5bdf1707a9723c8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b77d9fe-0fa2-4b75-9e89-692519914275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b77d9fe-0fa2-4b75-9e89-692519914275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83162e5b-3635-4105-886d-0c467f1110c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83162e5b-3635-4105-886d-0c467f1110c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c85e490-d966-4571-a12b-d63d286b6b5f', 'volume_name': 'volume-8c85e490-d966-4571-a12b-d63d286b6b5f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17124cc-03fd-49ea-8161-739c6718f25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17124cc-03fd-49ea-8161-739c6718f25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9f1a33-e7b5-48cd-b8c3-9839401f79e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:51 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Volume 8c85e490-d966-4571-a12b-d63d286b6b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c85e490-d966-4571-a12b-d63d286b6b5f', 'volume_size': 1} Jun 25 18:07:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:52 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 1073741824" returned: 0 in 1.390s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:52 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 Jun 25 18:07:52 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:53 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54" returned: 0 in 1.005s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] <== create_volume: return (2467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.471s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.031s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-88438680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c85e490-d966-4571-a12b-d63d286b6b5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f7e3a7c143846afa28af665b68fe960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:51Z,use_quota=True,user_id='5e10dadd70a647d5bdf1707a9723c8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Creating volume 8c85e490-d966-4571-a12b-d63d286b6b5f {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:07:53 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:53 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f 1073741824 Jun 25 18:07:53 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df240c5a-9309-4e5a-8dff-deacf7f2efea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfedb0d-263d-47e6-9a2c-c48f52af2ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:53 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Volume volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 (e8c11b3c-f94b-4048-bedc-1c173b5c8d54): created successfully Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfedb0d-263d-47e6-9a2c-c48f52af2ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Flow 'volume_create_manager' (605948c2-da30-4748-976c-4b5e113b7b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:53 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2e9d0bf7-428c-4f37-80af-17927d3f0763 tempest-DeleteServersTestJSON-988290834 None] Created volume successfully. Jun 25 18:07:54 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f 1073741824" returned: 0 in 1.483s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:54 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f Jun 25 18:07:54 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:55 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f" returned: 0 in 0.934s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] <== create_volume: return (2483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:07:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9f1a33-e7b5-48cd-b8c3-9839401f79e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c85e490-d966-4571-a12b-d63d286b6b5f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c14eaf-be35-4378-bcd0-ba2678cbd586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:55 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Volume volume-8c85e490-d966-4571-a12b-d63d286b6b5f (8c85e490-d966-4571-a12b-d63d286b6b5f): created successfully Jun 25 18:07:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c14eaf-be35-4378-bcd0-ba2678cbd586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Flow 'volume_create_manager' (47620dab-a3b8-4602-a305-755b7239e491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:55 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a63925ab-9d43-4b89-a938-5bd9e9b143e3 tempest-VolumesTestJSON-231148243 None] Created volume successfully. Jun 25 18:07:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Acquiring lock "cinder-8c85e490-d966-4571-a12b-d63d286b6b5f-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:07:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Lock "cinder-8c85e490-d966-4571-a12b-d63d286b6b5f-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:07:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Acquiring lock "cinder-quobyte-8c85e490-d966-4571-a12b-d63d286b6b5f" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:07:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Lock "cinder-quobyte-8c85e490-d966-4571-a12b-d63d286b6b5f" acquired by "delete_volume" :: waited 0.077s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:07:59 devstack cinder-volume[93767]: INFO oslo.privsep.daemon [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpijzfa6yh/privsep.sock'] Jun 25 18:07:59 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpijzfa6yh/privsep.sock Jun 25 18:07:59 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:59 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 25 18:07:59 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 18:07:59 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 18:07:59 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 18:07:59 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 18:07:59 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 18:07:59 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 18:07:59 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 18:07:59 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 25 18:08:00 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 25 18:08:00 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 18:08:00 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 18:08:00 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 18:08:00 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 18:08:00 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 18:08:00 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 18:08:00 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 18:08:00 devstack cinder-volume[93767]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 25 18:08:01 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:01 devstack cinder-volume[93767]: INFO oslo.privsep.daemon [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Spawned new privsep daemon via rootwrap Jun 25 18:08:01 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Accepted privsep connection to /tmp/tmpijzfa6yh/privsep.sock {{(pid=93767) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 25 18:08:01 devstack cinder-volume[93767]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 25 18:08:01 devstack cinder-volume[93767]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 25 18:08:01 devstack cinder-volume[93767]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 25 18:08:01 devstack cinder-volume[93767]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94756 Jun 25 18:08:01 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fc1014-b534-4bee-91ee-d931ca7f55f4]: (2,) {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:01 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd692cf-6665-4c1d-9804-da1f33311ebb]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:01 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f Jun 25 18:08:01 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:01 devstack cinder-volume[93767]: WARNING py.warnings [req-f4853cb5-0f09-402b-9fb7-afd064d21718 req-01fd7977-e4d3-46d5-8e76-e70b868dca97 tempest-DeleteServersTestJSON-988290834 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 25 18:08:01 devstack cinder-volume[93767]: .first() Jun 25 18:08:01 devstack cinder-volume[93767]: Jun 25 18:08:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f4853cb5-0f09-402b-9fb7-afd064d21718 req-01fd7977-e4d3-46d5-8e76-e70b868dca97 tempest-DeleteServersTestJSON-988290834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f4853cb5-0f09-402b-9fb7-afd064d21718 req-01fd7977-e4d3-46d5-8e76-e70b868dca97 tempest-DeleteServersTestJSON-988290834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:01 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e38520-8c56-4aa5-ad69-6ea3b98b1d87]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f4853cb5-0f09-402b-9fb7-afd064d21718 req-01fd7977-e4d3-46d5-8e76-e70b868dca97 tempest-DeleteServersTestJSON-988290834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:01 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 Jun 25 18:08:01 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:02 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f" returned: 0 in 1.266s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:02 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f Jun 25 18:08:02 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:02 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f4853cb5-0f09-402b-9fb7-afd064d21718 req-01fd7977-e4d3-46d5-8e76-e70b868dca97 tempest-DeleteServersTestJSON-988290834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54" returned: 0 in 1.180s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f4853cb5-0f09-402b-9fb7-afd064d21718 req-01fd7977-e4d3-46d5-8e76-e70b868dca97 tempest-DeleteServersTestJSON-988290834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.203s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-f4853cb5-0f09-402b-9fb7-afd064d21718 req-01fd7977-e4d3-46d5-8e76-e70b868dca97 tempest-DeleteServersTestJSON-988290834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c0bec26-436e-4b7b-b922-d51e8eca4c86', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:08:03 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-f4853cb5-0f09-402b-9fb7-afd064d21718 req-01fd7977-e4d3-46d5-8e76-e70b868dca97 tempest-DeleteServersTestJSON-988290834 None] attachment_update completed successfully. Jun 25 18:08:03 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c85e490-d966-4571-a12b-d63d286b6b5f" returned: 0 in 0.886s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Lock "cinder-quobyte-8c85e490-d966-4571-a12b-d63d286b6b5f" released by "delete_volume" :: held 4.790s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:03 devstack cinder-volume[93767]: WARNING cinder.quota [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:08:03 devstack cinder-volume[93767]: WARNING cinder.quota [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Created reservations ['562a630f-5041-4043-8184-7b745c58e2b5', 'bcc2372c-1dfc-4047-9072-da27164f993d', '1de71eed-3f84-4e17-839b-0f8b18682f3d', 'dc703208-a2db-442e-93f6-d3a96f754226'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:04 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:08:04 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Acquiring lock "cinder-8e61f853-7067-4f2b-bef1-0d966632a557-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Lock "cinder-8e61f853-7067-4f2b-bef1-0d966632a557-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Acquiring lock "cinder-quobyte-8e61f853-7067-4f2b-bef1-0d966632a557" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Lock "cinder-quobyte-8e61f853-7067-4f2b-bef1-0d966632a557" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:04 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.914s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:04 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Deleted volume successfully. Jun 25 18:08:04 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df6a51b-abf8-4b0e-9cd6-ae22663789fa]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-28ec63cc-fafc-494c-81bd-670a46b6273a tempest-VolumesTestJSON-231148243 None] Lock "cinder-8c85e490-d966-4571-a12b-d63d286b6b5f-delete_volume" released by "delete_volume" :: held 6.304s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:05 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557 Jun 25 18:08:05 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:05 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557" returned: 0 in 0.891s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:05 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557 Jun 25 18:08:05 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:06 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e61f853-7067-4f2b-bef1-0d966632a557" returned: 0 in 0.773s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Lock "cinder-quobyte-8e61f853-7067-4f2b-bef1-0d966632a557" released by "delete_volume" :: held 1.766s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:06 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Created reservations ['234c0f00-4dac-4eb2-b8e1-b4f04fc5877d', '89e6e0fa-3e62-4f50-a085-48439b795529', '60754a90-6c6b-4010-9176-1393dd85b9f5', 'a71b9c1c-a499-4d76-9c6f-2929f5353413'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:06 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:08:06 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Acquiring lock "cinder-8c5b8921-df36-4e64-b2f4-32881e6aac0f-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Lock "cinder-8c5b8921-df36-4e64-b2f4-32881e6aac0f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Acquiring lock "cinder-quobyte-8c5b8921-df36-4e64-b2f4-32881e6aac0f" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Lock "cinder-quobyte-8c5b8921-df36-4e64-b2f4-32881e6aac0f" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:07 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa15138-1684-4d28-a7bd-2392bd9023de]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:07 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f Jun 25 18:08:07 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:07 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.977s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:07 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:07 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Deleted volume successfully. Jun 25 18:08:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-03217c7e-d589-4477-88b7-1bf1a4c21a3d tempest-VolumesTestJSON-231148243 None] Lock "cinder-8e61f853-7067-4f2b-bef1-0d966632a557-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:08 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f" returned: 0 in 1.646s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:09 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f Jun 25 18:08:09 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:10 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8c5b8921-df36-4e64-b2f4-32881e6aac0f" returned: 0 in 1.611s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Lock "cinder-quobyte-8c5b8921-df36-4e64-b2f4-32881e6aac0f" released by "delete_volume" :: held 3.349s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:10 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Created reservations ['f5830ebc-8376-47ce-8a41-fb0e78786e53', '77829416-3b0b-4892-90c3-049d2035a8c5', '41b841b8-100b-4d65-b9ed-a7a5280244ef', '338db123-8614-4147-8179-e4e8cf433812'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:11 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:08:11 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:12 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.725s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:12 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:12 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Deleted volume successfully. Jun 25 18:08:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3f024558-1c18-4161-90ba-881f98ec2bfc tempest-VolumesTestJSON-231148243 None] Lock "cinder-8c5b8921-df36-4e64-b2f4-32881e6aac0f-delete_volume" released by "delete_volume" :: held 5.685s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:14 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-f9d514c6-b8a2-455d-8187-1a00a18cb644 req-340f923f-3c1d-489f-aed9-f930d9ec649f tempest-DeleteServersTestJSON-988290834 None] Terminate volume connection completed successfully. Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-f9d514c6-b8a2-455d-8187-1a00a18cb644 req-340f923f-3c1d-489f-aed9-f930d9ec649f tempest-DeleteServersTestJSON-988290834 None] Deleting attachment 7c0bec26-436e-4b7b-b922-d51e8eca4c86. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Flow 'volume_create_manager' (a7c60be9-5042-4fde-9fb0-32bb639be442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44066927-735d-4b3d-81d8-21db55aa0e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44066927-735d-4b3d-81d8-21db55aa0e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-320197825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753abd52-0496-4a80-8145-d1f73f1495b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccec565a8bb441e590570c4eb9c463db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:14Z,use_quota=True,user_id='07afaf3a2a01481790e37f25bcf4ff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873e2bf3-56d4-458f-b25b-105bb2c7d232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873e2bf3-56d4-458f-b25b-105bb2c7d232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e83a8c-314c-4523-94d9-0634a9a82016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e83a8c-314c-4523-94d9-0634a9a82016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753abd52-0496-4a80-8145-d1f73f1495b7', 'volume_name': 'volume-753abd52-0496-4a80-8145-d1f73f1495b7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e45bcd-90f5-4fe8-86b4-a205d57642b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e45bcd-90f5-4fe8-86b4-a205d57642b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882484fe-cc80-4655-a112-80ade0242d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:14 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Volume 753abd52-0496-4a80-8145-d1f73f1495b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753abd52-0496-4a80-8145-d1f73f1495b7', 'volume_size': 1} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-320197825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753abd52-0496-4a80-8145-d1f73f1495b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccec565a8bb441e590570c4eb9c463db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:14Z,use_quota=True,user_id='07afaf3a2a01481790e37f25bcf4ff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Creating volume 753abd52-0496-4a80-8145-d1f73f1495b7 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:08:14 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:08:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:14 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7 1073741824 Jun 25 18:08:14 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:15 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7 1073741824" returned: 0 in 1.339s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:15 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7 Jun 25 18:08:15 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:16 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7" returned: 0 in 0.868s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:08:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882484fe-cc80-4655-a112-80ade0242d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753abd52-0496-4a80-8145-d1f73f1495b7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59d3c07-7aa1-4d29-8c73-07be74dbcc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:16 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Volume volume-753abd52-0496-4a80-8145-d1f73f1495b7 (753abd52-0496-4a80-8145-d1f73f1495b7): created successfully Jun 25 18:08:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59d3c07-7aa1-4d29-8c73-07be74dbcc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Flow 'volume_create_manager' (a7c60be9-5042-4fde-9fb0-32bb639be442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:16 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6ed0eaa3-04bf-4be2-9ff1-2c0ef89590a0 tempest-VolumesAdminNegativeTest-912555688 None] Created volume successfully. Jun 25 18:08:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Acquiring lock "cinder-e8c11b3c-f94b-4048-bedc-1c173b5c8d54-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Lock "cinder-e8c11b3c-f94b-4048-bedc-1c173b5c8d54-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Acquiring lock "cinder-quobyte-e8c11b3c-f94b-4048-bedc-1c173b5c8d54" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Lock "cinder-quobyte-e8c11b3c-f94b-4048-bedc-1c173b5c8d54" acquired by "delete_volume" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67d1095-b5d3-43e4-aef5-f9c7e5f6c2aa]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:19 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 Jun 25 18:08:19 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Acquiring lock "cinder-753abd52-0496-4a80-8145-d1f73f1495b7-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Lock "cinder-753abd52-0496-4a80-8145-d1f73f1495b7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Acquiring lock "cinder-quobyte-753abd52-0496-4a80-8145-d1f73f1495b7" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Lock "cinder-quobyte-753abd52-0496-4a80-8145-d1f73f1495b7" acquired by "delete_volume" :: waited 0.054s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:19 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cc4a1a-56c2-47e8-a146-17165af1236d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:19 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7 Jun 25 18:08:19 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:20 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ece73833-f7ed-4560-9bae-db5ed02f1df1 tempest-GroupsTest-312024105 None] Group tempest-Group1-1728812228: creating Jun 25 18:08:20 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ece73833-f7ed-4560-9bae-db5ed02f1df1 tempest-GroupsTest-312024105 None] Group tempest-Group1-1728812228: created successfully Jun 25 18:08:20 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ece73833-f7ed-4560-9bae-db5ed02f1df1 tempest-GroupsTest-312024105 None] Create group completed successfully. Jun 25 18:08:20 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54" returned: 0 in 1.797s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:20 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54 Jun 25 18:08:20 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:20 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7" returned: 0 in 1.414s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:20 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7 Jun 25 18:08:20 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:21 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e8c11b3c-f94b-4048-bedc-1c173b5c8d54" returned: 0 in 0.908s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Lock "cinder-quobyte-e8c11b3c-f94b-4048-bedc-1c173b5c8d54" released by "delete_volume" :: held 2.778s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:21 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Created reservations ['bf53e8aa-b2b2-412e-a2dd-5305f008930d', '84522fc9-9a44-4130-859c-72f61666615f', '44117b6b-2482-4b0f-9f8e-5e20ee080cd6', '1085b2b8-0451-4923-ad8b-0934ffe67c56'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:21 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-753abd52-0496-4a80-8145-d1f73f1495b7" returned: 0 in 0.920s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Lock "cinder-quobyte-753abd52-0496-4a80-8145-d1f73f1495b7" released by "delete_volume" :: held 2.453s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5102d43a-865c-4fa1-8e4a-df1f910774cf tempest-GroupsTest-312024105 None] Group tempest-Group2-568727360: creating Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5102d43a-865c-4fa1-8e4a-df1f910774cf tempest-GroupsTest-312024105 None] Group tempest-Group2-568727360: created successfully Jun 25 18:08:22 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:08:22 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5102d43a-865c-4fa1-8e4a-df1f910774cf tempest-GroupsTest-312024105 None] Create group completed successfully. Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Created reservations ['ceec5ec5-d971-4672-8e1b-b85e10c0825d', '78ab819c-5681-4dc6-8390-6212fa04b441', '454b6a1c-c4d0-40fa-9253-b1237ce432d7', '0aff2ebf-53a2-424a-b1e1-d9367e1b882f'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:22 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:08:22 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:23 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.059s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:23 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Deleted volume successfully. Jun 25 18:08:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce33f305-d6c3-46ff-b74c-54d64c591cf5 tempest-DeleteServersTestJSON-988290834 None] Lock "cinder-e8c11b3c-f94b-4048-bedc-1c173b5c8d54-delete_volume" released by "delete_volume" :: held 4.521s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:23 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.206s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:23 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Deleted volume successfully. Jun 25 18:08:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c22d437f-a592-4b67-8f51-dda37b2169bf tempest-VolumesAdminNegativeTest-912555688 None] Lock "cinder-753abd52-0496-4a80-8145-d1f73f1495b7-delete_volume" released by "delete_volume" :: held 4.299s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Flow 'volume_create_manager' (b47e88ef-3f6d-436d-b33d-63c84ad5cc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc6d3f4-cd9a-4d7d-83f2-082145ad085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc6d3f4-cd9a-4d7d-83f2-082145ad085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-372496031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08abcdbe-f02d-4273-aaa1-1953558100c1,host='devstack@QuobyteHD#QuobyteHD',id=07868560-092d-4606-b5ec-12a20a63aa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca7a8ddf45740d589fdeebfac51146b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:24Z,use_quota=True,user_id='76d7e40e7ab34e1798b6f38e38ceb347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(596b657c-5b48-457b-9dca-b5486bd5ab51),volume_type_id=596b657c-5b48-457b-9dca-b5486bd5ab51)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4544c3dd-5b8e-4bfb-936e-ad34eaa7718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4544c3dd-5b8e-4bfb-936e-ad34eaa7718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765cedf4-b64c-4697-84e3-c0ea6b2a7236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765cedf4-b64c-4697-84e3-c0ea6b2a7236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07868560-092d-4606-b5ec-12a20a63aa1a', 'volume_name': 'volume-07868560-092d-4606-b5ec-12a20a63aa1a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf45a83d-552b-4715-b7f3-b7b8ddbe9e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf45a83d-552b-4715-b7f3-b7b8ddbe9e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482eb059-7e21-4fc4-8c81-252fe3bd670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:24 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Volume 07868560-092d-4606-b5ec-12a20a63aa1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07868560-092d-4606-b5ec-12a20a63aa1a', 'volume_size': 1} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08abcdbe-f02d-4273-aaa1-1953558100c1,created_at=2026-06-25T16:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-372496031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08abcdbe-f02d-4273-aaa1-1953558100c1,host='devstack@QuobyteHD#QuobyteHD',id=07868560-092d-4606-b5ec-12a20a63aa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca7a8ddf45740d589fdeebfac51146b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:24Z,use_quota=True,user_id='76d7e40e7ab34e1798b6f38e38ceb347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(596b657c-5b48-457b-9dca-b5486bd5ab51),volume_type_id=596b657c-5b48-457b-9dca-b5486bd5ab51)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Creating volume 07868560-092d-4606-b5ec-12a20a63aa1a {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:08:24 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:08:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:24 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a 1073741824 Jun 25 18:08:24 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:26 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a 1073741824" returned: 0 in 1.434s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:26 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a Jun 25 18:08:26 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:26 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a" returned: 0 in 0.853s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:08:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482eb059-7e21-4fc4-8c81-252fe3bd670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07868560-092d-4606-b5ec-12a20a63aa1a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b984c1d8-e627-47ee-9301-7c5d9f048075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:27 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Volume volume-07868560-092d-4606-b5ec-12a20a63aa1a (07868560-092d-4606-b5ec-12a20a63aa1a): created successfully Jun 25 18:08:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b984c1d8-e627-47ee-9301-7c5d9f048075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Flow 'volume_create_manager' (b47e88ef-3f6d-436d-b33d-63c84ad5cc14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:27 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-23c11e35-a46f-47ef-9a85-0d9b6bdb4321 tempest-GroupsTest-312024105 None] Created volume successfully. Jun 25 18:08:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Acquiring lock "cinder-quobyte-07868560-092d-4606-b5ec-12a20a63aa1a" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Lock "cinder-quobyte-07868560-092d-4606-b5ec-12a20a63aa1a" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[42defda6-ef98-46c2-bd66-14cbe816cda2]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:29 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a Jun 25 18:08:29 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:30 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a" returned: 0 in 1.219s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:30 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a Jun 25 18:08:30 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:31 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07868560-092d-4606-b5ec-12a20a63aa1a" returned: 0 in 0.913s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Lock "cinder-quobyte-07868560-092d-4606-b5ec-12a20a63aa1a" released by "delete_volume" :: held 2.213s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Created reservations ['3fa30b7f-32b7-4bc2-9ea8-973ba7adf2b9'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:31 devstack cinder-volume[93767]: WARNING cinder.quota [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1813742381 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1813742381, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:08:31 devstack cinder-volume[93767]: WARNING cinder.quota [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1813742381 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1813742381, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Created reservations ['a303cc36-16ec-4d5b-b773-2f4dc31ee009', '5550abdb-3b06-4139-a754-818d6ac2282e', '92c9e8a4-7073-46c0-90e5-25ca6af31ce8', '74f37695-41a4-44b8-9050-e87b688665d4'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:31 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:08:31 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:32 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.118s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:32 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:32 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d867b583-1e5f-434b-bf4f-02052da07d14 tempest-GroupsTest-312024105 None] Delete group completed successfully. Jun 25 18:08:33 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] Created reservations ['2ad118e1-8f34-4fdd-aac5-98cac3a28919'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:33 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:08:33 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:34 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.966s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:34 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:34 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4d64b857-187f-4eea-b8cf-1ebd64e2ca0c tempest-GroupsTest-312024105 None] Delete group completed successfully. Jun 25 18:08:34 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=55,cinder:INSERT=17,cinder:UPDATE=73,cinder:DELETE=8 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:08:34 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8f32b3a4-987c-4135-bef2-bafeee23e23b tempest-GroupsTest-312024105 None] Group tempest-GroupsTest-Group-622883086: creating Jun 25 18:08:34 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=67,cinder:UPDATE=76,cinder:INSERT=15,cinder:DELETE=3 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:08:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8f32b3a4-987c-4135-bef2-bafeee23e23b tempest-GroupsTest-312024105 None] Group tempest-GroupsTest-Group-622883086: created successfully Jun 25 18:08:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8f32b3a4-987c-4135-bef2-bafeee23e23b tempest-GroupsTest-312024105 None] Create group completed successfully. Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Flow 'volume_create_manager' (c7abab16-35ed-4640-a390-a6a685bf2781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b22b1e-196c-409f-9cad-f6ef6b02a403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b22b1e-196c-409f-9cad-f6ef6b02a403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537590355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=931e719c-4a90-4dc1-9c3e-bdc2d76c559c,host='devstack@QuobyteHD#QuobyteHD',id=6311137d-a7d7-4924-a743-1eecd7dd41c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca7a8ddf45740d589fdeebfac51146b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:37Z,use_quota=True,user_id='76d7e40e7ab34e1798b6f38e38ceb347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(053a26a0-d1e8-45b6-be0c-4eafdde2d2c8),volume_type_id=053a26a0-d1e8-45b6-be0c-4eafdde2d2c8)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d88f304-a702-4af5-8fca-0fb69d06457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d88f304-a702-4af5-8fca-0fb69d06457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f304c7-dd89-4bf7-adcb-369df723e905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f304c7-dd89-4bf7-adcb-369df723e905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6311137d-a7d7-4924-a743-1eecd7dd41c4', 'volume_name': 'volume-6311137d-a7d7-4924-a743-1eecd7dd41c4', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8c62dd-2b8f-41f3-8b12-208139b3308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8c62dd-2b8f-41f3-8b12-208139b3308e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dd238d-65cd-48dd-9adb-10a6a49cf3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:36 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Volume 6311137d-a7d7-4924-a743-1eecd7dd41c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6311137d-a7d7-4924-a743-1eecd7dd41c4', 'volume_size': 1} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=931e719c-4a90-4dc1-9c3e-bdc2d76c559c,created_at=2026-06-25T16:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537590355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=931e719c-4a90-4dc1-9c3e-bdc2d76c559c,host='devstack@QuobyteHD#QuobyteHD',id=6311137d-a7d7-4924-a743-1eecd7dd41c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca7a8ddf45740d589fdeebfac51146b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:37Z,use_quota=True,user_id='76d7e40e7ab34e1798b6f38e38ceb347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(053a26a0-d1e8-45b6-be0c-4eafdde2d2c8),volume_type_id=053a26a0-d1e8-45b6-be0c-4eafdde2d2c8)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Creating volume 6311137d-a7d7-4924-a743-1eecd7dd41c4 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:08:36 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:08:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:37 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 1073741824 Jun 25 18:08:37 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:38 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 1073741824" returned: 0 in 1.078s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:38 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 Jun 25 18:08:38 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:39 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4" returned: 0 in 0.898s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:08:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dd238d-65cd-48dd-9adb-10a6a49cf3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6311137d-a7d7-4924-a743-1eecd7dd41c4', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4b98f6-61b0-48a0-b2a9-ab2a0f5905a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Volume volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 (6311137d-a7d7-4924-a743-1eecd7dd41c4): created successfully Jun 25 18:08:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4b98f6-61b0-48a0-b2a9-ab2a0f5905a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Flow 'volume_create_manager' (c7abab16-35ed-4640-a390-a6a685bf2781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-01a200a6-b82a-4245-bf2c-7cdbd21684bd tempest-GroupsTest-312024105 None] Created volume successfully. Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Flow 'volume_create_manager' (4833206c-1c63-4717-8b25-9342566f2733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ca65b7-99ed-40b9-8fc9-e0eb42b83a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ca65b7-99ed-40b9-8fc9-e0eb42b83a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943281411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=931e719c-4a90-4dc1-9c3e-bdc2d76c559c,host='devstack@QuobyteHD#QuobyteHD',id=ec6797f6-7d2d-4084-af81-be4bd4b18f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca7a8ddf45740d589fdeebfac51146b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:40Z,use_quota=True,user_id='76d7e40e7ab34e1798b6f38e38ceb347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(053a26a0-d1e8-45b6-be0c-4eafdde2d2c8),volume_type_id=053a26a0-d1e8-45b6-be0c-4eafdde2d2c8)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d42978-6386-40d8-a498-6ab7b8e79c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d42978-6386-40d8-a498-6ab7b8e79c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d7817a-1bc7-4d70-b6a6-6ac93c0256be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d7817a-1bc7-4d70-b6a6-6ac93c0256be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6797f6-7d2d-4084-af81-be4bd4b18f8b', 'volume_name': 'volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9985a69-5ece-42c9-930d-1283a69c0cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9985a69-5ece-42c9-930d-1283a69c0cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6708c0ca-49df-43a0-ba8b-9fa517cdc522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Volume ec6797f6-7d2d-4084-af81-be4bd4b18f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b', 'volume_size': 1} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=931e719c-4a90-4dc1-9c3e-bdc2d76c559c,created_at=2026-06-25T16:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943281411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=931e719c-4a90-4dc1-9c3e-bdc2d76c559c,host='devstack@QuobyteHD#QuobyteHD',id=ec6797f6-7d2d-4084-af81-be4bd4b18f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca7a8ddf45740d589fdeebfac51146b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:40Z,use_quota=True,user_id='76d7e40e7ab34e1798b6f38e38ceb347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(053a26a0-d1e8-45b6-be0c-4eafdde2d2c8),volume_type_id=053a26a0-d1e8-45b6-be0c-4eafdde2d2c8)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Creating volume ec6797f6-7d2d-4084-af81-be4bd4b18f8b {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:08:40 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:40 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b 1073741824 Jun 25 18:08:40 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:40 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:08:40 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:41 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.933s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:08:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 8 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:08:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:08:41 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b 1073741824" returned: 0 in 1.170s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:41 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b Jun 25 18:08:41 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:42 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b" returned: 0 in 0.734s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:08:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6708c0ca-49df-43a0-ba8b-9fa517cdc522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7f7452-a21b-43f6-b97f-26355d901a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:42 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Volume volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b (ec6797f6-7d2d-4084-af81-be4bd4b18f8b): created successfully Jun 25 18:08:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7f7452-a21b-43f6-b97f-26355d901a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Flow 'volume_create_manager' (4833206c-1c63-4717-8b25-9342566f2733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:42 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1fcf4a67-d721-4106-bdb1-1acedfc1e8a2 tempest-GroupsTest-312024105 None] Created volume successfully. Jun 25 18:08:43 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-006da316-ab5a-4b01-9bf9-a9ed39c80dfc tempest-GroupsTest-312024105 None] Update group completed successfully. Jun 25 18:08:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c0e163b3-6e3e-4168-9101-ad5d436d01f0 tempest-GroupsTest-312024105 None] Update group completed successfully. Jun 25 18:08:46 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Acquiring lock "cinder-quobyte-6311137d-a7d7-4924-a743-1eecd7dd41c4" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:46 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Lock "cinder-quobyte-6311137d-a7d7-4924-a743-1eecd7dd41c4" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:46 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[75534c4c-55a1-4d10-9e9e-2883e4af50f5]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:46 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 Jun 25 18:08:46 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:47 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4" returned: 0 in 0.966s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:47 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4 Jun 25 18:08:47 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:48 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6311137d-a7d7-4924-a743-1eecd7dd41c4" returned: 0 in 0.864s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:48 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Lock "cinder-quobyte-6311137d-a7d7-4924-a743-1eecd7dd41c4" released by "delete_volume" :: held 1.893s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:48 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Acquiring lock "cinder-quobyte-ec6797f6-7d2d-4084-af81-be4bd4b18f8b" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:48 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Lock "cinder-quobyte-ec6797f6-7d2d-4084-af81-be4bd4b18f8b" acquired by "delete_volume" :: waited 0.043s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:48 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df1bb52-6b3b-4678-95a0-5d15728bbff2]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:48 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b Jun 25 18:08:48 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b" returned: 0 in 1.050s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:49 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:49 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b Jun 25 18:08:49 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:50 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ec6797f6-7d2d-4084-af81-be4bd4b18f8b" returned: 0 in 0.874s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Lock "cinder-quobyte-ec6797f6-7d2d-4084-af81-be4bd4b18f8b" released by "delete_volume" :: held 1.989s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Created reservations ['6dfcc653-8a1b-4886-af2a-599873caf6cc'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:50 devstack cinder-volume[93767]: WARNING cinder.quota [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-930881577 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-930881577, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:08:50 devstack cinder-volume[93767]: WARNING cinder.quota [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-930881577 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-930881577, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Created reservations ['fd955e3a-2c19-4b67-ba70-a4aa77b9b495', 'a7435cab-684b-4261-9bc0-7e4efc4dce81', '7f8b9efc-5592-456f-9f8a-38d83356932c', '8d68a8c8-3e71-47a7-a4c9-ff39bd45a4e0'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Created reservations ['3737a418-6039-471b-b019-04924678f66e', '6bd2e74a-401a-4e08-9391-60da3643464f', '0bb03988-bd3e-40d1-b31a-ee2cc15c3b90', '30332e93-26fc-4685-a2b5-3d41ab28a6fd'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:51 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:08:51 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:51 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.932s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:51 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-34a7270e-3dea-46d5-b251-66102197c689 tempest-GroupsTest-312024105 None] Delete group completed successfully. Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Flow 'volume_create_manager' (2c5635c2-0b29-41c3-a10b-b142bad020c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfc483e-a3f0-464c-8b92-826a643d586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfc483e-a3f0-464c-8b92-826a643d586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-82421267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5adcd71dfcd84103ba6a168136026ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:57Z,use_quota=True,user_id='a487a53a1942457a9b50f429ce6bc2f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097523ba-0cbf-4092-a2da-18bc9bce4315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097523ba-0cbf-4092-a2da-18bc9bce4315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13b1125-7278-4cd1-8d11-faeb9bad79f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13b1125-7278-4cd1-8d11-faeb9bad79f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904', 'volume_name': 'volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359a408e-d034-488a-8c98-92b52fc13653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359a408e-d034-488a-8c98-92b52fc13653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cfcc45-0ea4-48e9-9b75-b2f909a4e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:56 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Volume 1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904', 'volume_size': 1} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-82421267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5adcd71dfcd84103ba6a168136026ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:57Z,use_quota=True,user_id='a487a53a1942457a9b50f429ce6bc2f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Creating volume 1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:08:56 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:08:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:56 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 1073741824 Jun 25 18:08:56 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:58 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 1073741824" returned: 0 in 1.230s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:58 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 Jun 25 18:08:58 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:58 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904" returned: 0 in 0.866s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:08:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cfcc45-0ea4-48e9-9b75-b2f909a4e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbed738-468e-4a34-93a0-5a52746bfe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:59 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Volume volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 (1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904): created successfully Jun 25 18:08:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbed738-468e-4a34-93a0-5a52746bfe29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Flow 'volume_create_manager' (2c5635c2-0b29-41c3-a10b-b142bad020c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:59 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ef6c068f-1f5b-4f93-98bb-dabb320749cd tempest-TaggedAttachmentsTest-1518679089 None] Created volume successfully. Jun 25 18:09:09 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=29,cinder:SELECT=28,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:09:09 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=20,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=7 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Flow 'volume_create_manager' (16246021-eac2-4d4a-9b28-3cecdda53365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7e8868-11fb-430c-b7ea-eefa3e8256e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7e8868-11fb-430c-b7ea-eefa3e8256e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-421300050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29836ac000d648dba0758184f607ae6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:25Z,use_quota=True,user_id='4af7d73219a44ab19a4bb7e094e10f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330dc6d3-3aa8-42a4-88fd-f83abcc214b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330dc6d3-3aa8-42a4-88fd-f83abcc214b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6bc554-76a9-4246-aea2-89c418033fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6bc554-76a9-4246-aea2-89c418033fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8', 'volume_name': 'volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87af195-dfb9-4272-b361-8af3c9171587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87af195-dfb9-4272-b361-8af3c9171587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8090de-101f-4c8d-a5ae-93e2656a0684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:24 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Volume c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8', 'volume_size': 1} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-421300050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29836ac000d648dba0758184f607ae6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:25Z,use_quota=True,user_id='4af7d73219a44ab19a4bb7e094e10f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Creating volume c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:24 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:09:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:24 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 1073741824 Jun 25 18:09:24 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:26 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 1073741824" returned: 0 in 1.209s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:26 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 Jun 25 18:09:26 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:26 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8" returned: 0 in 0.778s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:09:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8090de-101f-4c8d-a5ae-93e2656a0684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14059853-ab63-424e-83de-d8c330e4af67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:26 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Volume volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 (c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8): created successfully Jun 25 18:09:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14059853-ab63-424e-83de-d8c330e4af67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Flow 'volume_create_manager' (16246021-eac2-4d4a-9b28-3cecdda53365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:26 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2e45812d-c88c-40fa-8c19-a77cf60f6084 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Created volume successfully. Jun 25 18:09:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Acquiring lock "cinder-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "cinder-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Acquiring lock "cinder-quobyte-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "cinder-quobyte-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:28 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fb80ad-f280-4abd-b2de-0ec6b0231580]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:28 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 Jun 25 18:09:28 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:28 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8" returned: 0 in 0.849s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:29 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8 Jun 25 18:09:29 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:29 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8" returned: 0 in 0.920s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "cinder-quobyte-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8" released by "delete_volume" :: held 1.822s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:29 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Created reservations ['f019a3ef-78e0-45b3-945c-e7c249e83cdb', '4eb136e7-7aa3-4753-8a4d-603baef87105', '4c783cad-3064-4bb2-8b28-ac7ca1e8509d', '66ace7e9-acc4-4719-873b-0f8c64f62e37'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:30 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:09:30 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:31 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.269s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:31 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Deleted volume successfully. Jun 25 18:09:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0fddf27-aad8-4012-aac0-1e74734b3cf6 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "cinder-c0ddd0ef-9a14-474f-83dc-2cacc39c8fd8-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:31 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:09:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Flow 'volume_create_manager' (61550a36-60bc-4878-be50-de6bba4719ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9486e467-3e4a-4335-81ca-12b4279133ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9486e467-3e4a-4335-81ca-12b4279133ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1053170573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee197a1c-83c8-409c-b99e-1bfd945fb924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29836ac000d648dba0758184f607ae6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:32Z,use_quota=True,user_id='4af7d73219a44ab19a4bb7e094e10f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7861023a-53ec-458c-a9d0-9a9631a2126b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7861023a-53ec-458c-a9d0-9a9631a2126b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a002d2-88f1-4b75-83a5-d91194a060bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a002d2-88f1-4b75-83a5-d91194a060bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee197a1c-83c8-409c-b99e-1bfd945fb924', 'volume_name': 'volume-ee197a1c-83c8-409c-b99e-1bfd945fb924', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ece2f07-9d19-43aa-8a7a-4c9b859b5da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ece2f07-9d19-43aa-8a7a-4c9b859b5da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5540ee5-f2b1-4586-a95d-889943c1eec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:32 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Volume ee197a1c-83c8-409c-b99e-1bfd945fb924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee197a1c-83c8-409c-b99e-1bfd945fb924', 'volume_size': 1} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1053170573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee197a1c-83c8-409c-b99e-1bfd945fb924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29836ac000d648dba0758184f607ae6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:32Z,use_quota=True,user_id='4af7d73219a44ab19a4bb7e094e10f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Creating volume ee197a1c-83c8-409c-b99e-1bfd945fb924 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:32 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:09:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:32 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 1073741824 Jun 25 18:09:32 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:33 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 1073741824" returned: 0 in 1.604s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:33 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 Jun 25 18:09:33 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:35 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924" returned: 0 in 1.549s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] <== create_volume: return (3239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:09:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.245s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5540ee5-f2b1-4586-a95d-889943c1eec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee197a1c-83c8-409c-b99e-1bfd945fb924', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f45a12e-3d15-469f-9465-bbc8ab81404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:35 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Volume volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 (ee197a1c-83c8-409c-b99e-1bfd945fb924): created successfully Jun 25 18:09:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f45a12e-3d15-469f-9465-bbc8ab81404f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Flow 'volume_create_manager' (61550a36-60bc-4878-be50-de6bba4719ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e2044941-5479-4d8e-bb9e-2e2c58ab1da0 tempest-VolumeQuotasAdminTestJSON-1130221468 None] Created volume successfully. Jun 25 18:09:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0634bd3c-b2cc-4b29-a0ee-464af9d7f470 tempest-VolumeQuotasAdminTestJSON-873085096 None] Transfer volume completed successfully. Jun 25 18:09:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Acquiring lock "cinder-ee197a1c-83c8-409c-b99e-1bfd945fb924-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Lock "cinder-ee197a1c-83c8-409c-b99e-1bfd945fb924-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Acquiring lock "cinder-quobyte-ee197a1c-83c8-409c-b99e-1bfd945fb924" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Lock "cinder-quobyte-ee197a1c-83c8-409c-b99e-1bfd945fb924" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:39 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f53173-223b-43c2-9efa-1111592669cf]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:39 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 Jun 25 18:09:39 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:09:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:40 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:09:40 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:40 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924" returned: 0 in 1.257s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:40 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924 Jun 25 18:09:40 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:42 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.802s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:42 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:43 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee197a1c-83c8-409c-b99e-1bfd945fb924" returned: 0 in 2.556s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:43 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Lock "cinder-quobyte-ee197a1c-83c8-409c-b99e-1bfd945fb924" released by "delete_volume" :: held 3.940s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:43 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Created reservations ['17f40932-9d98-49dd-998c-50b35cdf0a07', '2078a0b4-a188-4bb9-82d4-b697a339a932', 'c9daf947-c9d6-43b8-9e22-815b134bf075', 'c9b6b33e-7251-48fd-9c7d-4993dd1aa0ac'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:43 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:09:43 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:44 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.277s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:44 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Deleted volume successfully. Jun 25 18:09:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-528c618d-7cfd-481d-adb8-adb391471eaf tempest-VolumeQuotasAdminTestJSON-1328829453 None] Lock "cinder-ee197a1c-83c8-409c-b99e-1bfd945fb924-delete_volume" released by "delete_volume" :: held 5.718s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:53 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=24,cinder:INSERT=5,cinder:SELECT=10 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:09:54 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=19,cinder:UPDATE=20,cinder:DELETE=4,cinder:INSERT=5 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Flow 'volume_create_manager' (fd98d247-34f2-4d70-968c-7d10f65fc912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafb1a8b-2827-4d24-bc04-5b0ccf988f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafb1a8b-2827-4d24-bc04-5b0ccf988f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1441102774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa1bacb-6205-4e79-90eb-9836378f28e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8e632a50974b869287ea69582d5c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:57Z,use_quota=True,user_id='587d5c926c8d469bafaeae51d4b96a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9998027c-cd1c-49c8-965f-3149e41a31c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9998027c-cd1c-49c8-965f-3149e41a31c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecafa51-ac43-4e6d-a402-4c5f2d37225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecafa51-ac43-4e6d-a402-4c5f2d37225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa1bacb-6205-4e79-90eb-9836378f28e9', 'volume_name': 'volume-1aa1bacb-6205-4e79-90eb-9836378f28e9', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b4c443-4be6-4f24-99c1-fe5540ca0b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b4c443-4be6-4f24-99c1-fe5540ca0b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cdc156-ba4f-4423-bee5-b86936f442a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:57 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Volume 1aa1bacb-6205-4e79-90eb-9836378f28e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa1bacb-6205-4e79-90eb-9836378f28e9', 'volume_size': 1} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1441102774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa1bacb-6205-4e79-90eb-9836378f28e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8e632a50974b869287ea69582d5c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:57Z,use_quota=True,user_id='587d5c926c8d469bafaeae51d4b96a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Creating volume 1aa1bacb-6205-4e79-90eb-9836378f28e9 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:57 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:09:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:57 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 1073741824 Jun 25 18:09:57 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:59 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 1073741824" returned: 0 in 1.896s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:59 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 Jun 25 18:09:59 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:00 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9" returned: 0 in 1.185s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] <== create_volume: return (3177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:10:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.187s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cdc156-ba4f-4423-bee5-b86936f442a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa1bacb-6205-4e79-90eb-9836378f28e9', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3daec91c-e6bd-4c2f-9edb-e1e1d21c45f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:00 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Volume volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 (1aa1bacb-6205-4e79-90eb-9836378f28e9): created successfully Jun 25 18:10:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3daec91c-e6bd-4c2f-9edb-e1e1d21c45f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Flow 'volume_create_manager' (fd98d247-34f2-4d70-968c-7d10f65fc912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:00 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9d96e02d-d59e-47fd-a2e3-7d94d04d1699 tempest-ServerActionsTestOtherA-94941714 None] Created volume successfully. Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Flow 'volume_create_manager' (8fa7103c-6e6f-4fab-b9ee-79ef49f5b70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108d6285-65df-4b65-bf77-a2e8bea756d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108d6285-65df-4b65-bf77-a2e8bea756d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1863850142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97453606-f130-4763-9ad1-2fe38f6655b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5a091f69304dbd88e956ae55a96e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:07Z,use_quota=True,user_id='616e1161a8b645dcb155aaa5b2e00562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc2b73d-d255-45fe-b5fb-a15218eabaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc2b73d-d255-45fe-b5fb-a15218eabaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc73897d-b71e-40b0-917a-6df30516e419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc73897d-b71e-40b0-917a-6df30516e419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97453606-f130-4763-9ad1-2fe38f6655b6', 'volume_name': 'volume-97453606-f130-4763-9ad1-2fe38f6655b6', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50446f3c-d9b6-4162-b272-e0528bea13a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50446f3c-d9b6-4162-b272-e0528bea13a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c401e9-b822-4625-bc9e-878f725f0568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:06 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Volume 97453606-f130-4763-9ad1-2fe38f6655b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97453606-f130-4763-9ad1-2fe38f6655b6', 'volume_size': 1} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1863850142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97453606-f130-4763-9ad1-2fe38f6655b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5a091f69304dbd88e956ae55a96e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:07Z,use_quota=True,user_id='616e1161a8b645dcb155aaa5b2e00562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Creating volume 97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:10:06 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:10:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:06 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 1073741824 Jun 25 18:10:06 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:08 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 1073741824" returned: 0 in 1.292s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:08 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 Jun 25 18:10:08 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:10 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6" returned: 0 in 1.987s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] <== create_volume: return (3358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:10:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.365s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c401e9-b822-4625-bc9e-878f725f0568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97453606-f130-4763-9ad1-2fe38f6655b6', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70164e2-9979-471c-b3ea-68b85789e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:10 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Volume volume-97453606-f130-4763-9ad1-2fe38f6655b6 (97453606-f130-4763-9ad1-2fe38f6655b6): created successfully Jun 25 18:10:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70164e2-9979-471c-b3ea-68b85789e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Flow 'volume_create_manager' (8fa7103c-6e6f-4fab-b9ee-79ef49f5b70c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b54067c5-bc67-45e9-98e4-b3287467de93 tempest-VolumesDeleteCascade-1034476196 None] Created volume successfully. Jun 25 18:10:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Creating offline snapshot 2873325f-fde6-4425-81e7-4801817268f9 of volume 97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:10:11 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9ea950-f8d3-45df-8021-2cc5a8672b30]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:12 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 Jun 25 18:10:12 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:13 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6" returned: 0 in 1.506s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:13 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 1G Jun 25 18:10:13 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:14 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 1G" returned: 0 in 1.163s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97453606-f130-4763-9ad1-2fe38f6655b6 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:14 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97453606-f130-4763-9ad1-2fe38f6655b6 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 Jun 25 18:10:14 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:15 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97453606-f130-4763-9ad1-2fe38f6655b6 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9" returned: 0 in 0.811s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:15 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 is being set with open permissions: ugo+rw Jun 25 18:10:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:15 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 Jun 25 18:10:15 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:16 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9" returned: 0 in 0.732s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:16 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.info Jun 25 18:10:16 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:17 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.info" returned: 0 in 0.823s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:17 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.info is being set with open permissions: ugo+rw Jun 25 18:10:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:17 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.info Jun 25 18:10:17 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:17 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.info" returned: 0 in 0.721s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.939s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1c00a176-6110-42b1-a54b-6824a41f51f5 tempest-VolumesDeleteCascade-1034476196 None] Create snapshot completed successfully Jun 25 18:10:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-d703d6bc-4687-4582-9f7c-4f98128a7a65 req-a2e80975-80a6-4c67-ae7f-0fb2a5ff1055 tempest-TaggedAttachmentsTest-1518679089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-d703d6bc-4687-4582-9f7c-4f98128a7a65 req-a2e80975-80a6-4c67-ae7f-0fb2a5ff1055 tempest-TaggedAttachmentsTest-1518679089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[9089c56b-5d5a-4a9f-b0d2-5dd5a4439cca]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-d703d6bc-4687-4582-9f7c-4f98128a7a65 req-a2e80975-80a6-4c67-ae7f-0fb2a5ff1055 tempest-TaggedAttachmentsTest-1518679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:18 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 Jun 25 18:10:18 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:19 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-d703d6bc-4687-4582-9f7c-4f98128a7a65 req-a2e80975-80a6-4c67-ae7f-0fb2a5ff1055 tempest-TaggedAttachmentsTest-1518679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904" returned: 0 in 1.242s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-d703d6bc-4687-4582-9f7c-4f98128a7a65 req-a2e80975-80a6-4c67-ae7f-0fb2a5ff1055 tempest-TaggedAttachmentsTest-1518679089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.272s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.595s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Creating offline snapshot 8b155e04-f62e-4677-8239-31601531a960 of volume 97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:10:19 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[11729171-5aa5-4c60-a205-4c9dfe09c0bc]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-d703d6bc-4687-4582-9f7c-4f98128a7a65 req-a2e80975-80a6-4c67-ae7f-0fb2a5ff1055 tempest-TaggedAttachmentsTest-1518679089 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10e0b82e-5b4e-4d17-b6a0-b3e08e573223', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:10:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:19 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-d703d6bc-4687-4582-9f7c-4f98128a7a65 req-a2e80975-80a6-4c67-ae7f-0fb2a5ff1055 tempest-TaggedAttachmentsTest-1518679089 None] attachment_update completed successfully. Jun 25 18:10:19 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 Jun 25 18:10:19 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Flow 'volume_create_manager' (51a4bdf3-93e0-4929-adf6-850636611617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8e4e61-7059-4a67-9c8e-094590910256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8e4e61-7059-4a67-9c8e-094590910256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1384018710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb60bf3-339d-4762-9044-a9d05b8cde7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7613e7a63bf43c9ba151f55c0a53a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:20Z,use_quota=True,user_id='86eb7265a8f84240b692be61d6cbd81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56936c9-49c4-464c-8791-9abde54407c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56936c9-49c4-464c-8791-9abde54407c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8346352-8736-4633-a02d-2528146b93c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8346352-8736-4633-a02d-2528146b93c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb60bf3-339d-4762-9044-a9d05b8cde7a', 'volume_name': 'volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95bf154-15fe-4429-87fa-2797a1ab3c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95bf154-15fe-4429-87fa-2797a1ab3c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf2a7d5-7729-4c96-aba0-5d440eff1eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:20 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Volume 1bb60bf3-339d-4762-9044-a9d05b8cde7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a', 'volume_size': 1} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:20 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9" returned: 0 in 1.210s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97453606-f130-4763-9ad1-2fe38f6655b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:10:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:20 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 1G Jun 25 18:10:20 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:21 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 1G" returned: 0 in 1.153s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:21 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 Jun 25 18:10:21 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:22 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960" returned: 0 in 0.847s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:22 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 is being set with open permissions: ugo+rw Jun 25 18:10:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:22 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 Jun 25 18:10:22 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:23 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960" returned: 0 in 0.688s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.076s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.917s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1384018710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb60bf3-339d-4762-9044-a9d05b8cde7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7613e7a63bf43c9ba151f55c0a53a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:20Z,use_quota=True,user_id='86eb7265a8f84240b692be61d6cbd81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Creating volume 1bb60bf3-339d-4762-9044-a9d05b8cde7a {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:10:23 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:10:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:23 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a 1073741824 Jun 25 18:10:23 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0b2c44b8-6130-491c-8361-ac16ceec28f7 tempest-VolumesDeleteCascade-1034476196 None] Create snapshot completed successfully Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-97453606-f130-4763-9ad1-2fe38f6655b6-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-97453606-f130-4763-9ad1-2fe38f6655b6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Performing cascade delete. {{(pid=93767) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1031}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-2873325f-fde6-4425-81e7-4801817268f9-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-2873325f-fde6-4425-81e7-4801817268f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-97453606-f130-4763-9ad1-2fe38f6655b6" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-97453606-f130-4763-9ad1-2fe38f6655b6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-2873325f-fde6-4425-81e7-4801817268f9" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-2873325f-fde6-4425-81e7-4801817268f9" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Deleting offline snapshot 2873325f-fde6-4425-81e7-4801817268f9 of volume 97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] snapshot_file for this snap is: volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8be0aef-5f1b-41ec-bc43-009277de778a]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:24 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a 1073741824" returned: 0 in 1.391s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:24 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 Jun 25 18:10:24 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:24 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a Jun 25 18:10:24 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:25 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a" returned: 0 in 0.847s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.306s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:25 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf2a7d5-7729-4c96-aba0-5d440eff1eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1825e283-44af-44e9-a31a-3f602c39ae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9" returned: 0 in 1.074s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97453606-f130-4763-9ad1-2fe38f6655b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:10:25 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Volume volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a (1bb60bf3-339d-4762-9044-a9d05b8cde7a): created successfully Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1825e283-44af-44e9-a31a-3f602c39ae7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Flow 'volume_create_manager' (51a4bdf3-93e0-4929-adf6-850636611617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f382a87-b096-4c22-b71f-1e6125941496]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:25 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-11c7082b-2ddf-4a37-926f-ae7a7fe12e35 tempest-ServersNegativeTestJSON-217570010 None] Created volume successfully. Jun 25 18:10:26 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 Jun 25 18:10:26 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:26 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6" returned: 0 in 0.849s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:26 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7653edb8-a5a4-4f20-83c5-0971995bb306]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:26 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 Jun 25 18:10:26 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:27 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960" returned: 0 in 0.796s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97453606-f130-4763-9ad1-2fe38f6655b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:10:27 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[644ad8c4-5f58-4370-a8c3-7c947f8761b7]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:27 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 Jun 25 18:10:27 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:28 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-ff6ddc0c-1d88-4175-a53c-dcc86f8bbbe9 req-88a28ef7-a439-4137-8060-3e8aadcf4fd7 tempest-TaggedAttachmentsTest-1518679089 None] Terminate volume connection completed successfully. Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-ff6ddc0c-1d88-4175-a53c-dcc86f8bbbe9 req-88a28ef7-a439-4137-8060-3e8aadcf4fd7 tempest-TaggedAttachmentsTest-1518679089 None] Deleting attachment 10e0b82e-5b4e-4d17-b6a0-b3e08e573223. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:10:28 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9" returned: 0 in 1.101s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97453606-f130-4763-9ad1-2fe38f6655b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc941c60-131a-41ee-a71d-1019d36f2d2e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Flow 'volume_create_manager' (418c5fe0-34b4-4c69-934c-4ea36c2c3d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342b7b82-ded9-4a04-bd17-5fd22c042d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342b7b82-ded9-4a04-bd17-5fd22c042d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1599282169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddeed10-f9ee-4a38-a45d-9ee37690d47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7613e7a63bf43c9ba151f55c0a53a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:29Z,use_quota=True,user_id='86eb7265a8f84240b692be61d6cbd81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:28 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 Jun 25 18:10:28 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756655ad-b5ce-4430-9ae0-7e8d45739795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756655ad-b5ce-4430-9ae0-7e8d45739795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637fab7c-5682-4f5e-bcb6-c923262fe61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637fab7c-5682-4f5e-bcb6-c923262fe61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ddeed10-f9ee-4a38-a45d-9ee37690d47a', 'volume_name': 'volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2ecd30-1f77-48ba-b0dd-f899a2e2754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2ecd30-1f77-48ba-b0dd-f899a2e2754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e705bb-1639-4512-9445-cc7cfc481a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:28 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Volume 5ddeed10-f9ee-4a38-a45d-9ee37690d47a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a', 'volume_size': 1} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1599282169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddeed10-f9ee-4a38-a45d-9ee37690d47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7613e7a63bf43c9ba151f55c0a53a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:29Z,use_quota=True,user_id='86eb7265a8f84240b692be61d6cbd81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Creating volume 5ddeed10-f9ee-4a38-a45d-9ee37690d47a {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:10:28 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:10:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:28 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a 1073741824 Jun 25 18:10:28 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:29 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6" returned: 0 in 0.901s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:29 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 Jun 25 18:10:29 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:30 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a 1073741824" returned: 0 in 1.049s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:30 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a Jun 25 18:10:30 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:30 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9" returned: 0 in 0.995s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:30 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9 Jun 25 18:10:30 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:31 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a" returned: 0 in 0.992s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:10:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e705bb-1639-4512-9445-cc7cfc481a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4937d383-8896-4b88-ac8f-9da379224c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:31 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Volume volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a (5ddeed10-f9ee-4a38-a45d-9ee37690d47a): created successfully Jun 25 18:10:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4937d383-8896-4b88-ac8f-9da379224c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Flow 'volume_create_manager' (418c5fe0-34b4-4c69-934c-4ea36c2c3d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-dc4be7c5-a520-45be-b609-f4ccf4d82f82 tempest-ServersNegativeTestJSON-217570010 None] Created volume successfully. Jun 25 18:10:31 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.2873325f-fde6-4425-81e7-4801817268f9" returned: 0 in 0.737s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97453606-f130-4763-9ad1-2fe38f6655b6 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 -F qcow2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:31 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97453606-f130-4763-9ad1-2fe38f6655b6 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 -F qcow2 Jun 25 18:10:31 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:32 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97453606-f130-4763-9ad1-2fe38f6655b6 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 -F qcow2" returned: 0 in 1.218s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-2873325f-fde6-4425-81e7-4801817268f9" released by "_delete_snapshot" :: held 7.998s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-97453606-f130-4763-9ad1-2fe38f6655b6" released by "delete_snapshot" :: held 8.079s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:32 devstack cinder-volume[93767]: WARNING cinder.quota [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:10:32 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Created reservations ['a3468c41-caf9-46af-a39e-1c3a75c16c85', '5b6e806d-a79a-494d-a961-8f8bc39ab20f', '51c140f5-7dd6-4521-bf0f-5057b6767f10', '72b9db61-4fbc-43c7-9012-bc71dfaf5713'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:33 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Delete snapshot completed successfully. Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-2873325f-fde6-4425-81e7-4801817268f9-delete_snapshot" released by "delete_snapshot" :: held 8.527s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-8b155e04-f62e-4677-8239-31601531a960-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-8b155e04-f62e-4677-8239-31601531a960-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "cinder-5ddeed10-f9ee-4a38-a45d-9ee37690d47a-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-97453606-f130-4763-9ad1-2fe38f6655b6" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Lock "cinder-5ddeed10-f9ee-4a38-a45d-9ee37690d47a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-97453606-f130-4763-9ad1-2fe38f6655b6" acquired by "delete_snapshot" :: waited 0.053s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-8b155e04-f62e-4677-8239-31601531a960" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-8b155e04-f62e-4677-8239-31601531a960" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Deleting offline snapshot 8b155e04-f62e-4677-8239-31601531a960 of volume 97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] snapshot_file for this snap is: volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ea6509-482b-402c-bc3e-ac4a1ab41021]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "cinder-quobyte-5ddeed10-f9ee-4a38-a45d-9ee37690d47a" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Lock "cinder-quobyte-5ddeed10-f9ee-4a38-a45d-9ee37690d47a" acquired by "delete_volume" :: waited 0.056s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92bef20-a9a2-466c-b847-373c2a1c8543]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:33 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 Jun 25 18:10:33 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:33 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a Jun 25 18:10:33 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:34 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960" returned: 0 in 1.013s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97453606-f130-4763-9ad1-2fe38f6655b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:10:34 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce50b455-b4e4-4f43-85de-b062372426e7]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:34 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a" returned: 0 in 0.926s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:34 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a Jun 25 18:10:34 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:34 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 Jun 25 18:10:34 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:35 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5ddeed10-f9ee-4a38-a45d-9ee37690d47a" returned: 0 in 0.757s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Lock "cinder-quobyte-5ddeed10-f9ee-4a38-a45d-9ee37690d47a" released by "delete_volume" :: held 1.768s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Created reservations ['05f5e46e-9f04-4278-8242-323b5b7edb6c', '95583946-9e9b-4626-ace4-bde8ad292c40', 'ad66a79b-668d-4825-8153-92347e7fddad', '7d428aee-dbc1-44ff-ada3-5f564d9901d1'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:35 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:10:35 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:35 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6" returned: 0 in 1.076s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:35 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 Jun 25 18:10:35 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "cinder-1bb60bf3-339d-4762-9044-a9d05b8cde7a-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Lock "cinder-1bb60bf3-339d-4762-9044-a9d05b8cde7a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "cinder-quobyte-1bb60bf3-339d-4762-9044-a9d05b8cde7a" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Lock "cinder-quobyte-1bb60bf3-339d-4762-9044-a9d05b8cde7a" acquired by "delete_volume" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab135af6-0b9d-414b-9890-cb14dbb4009e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:36 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a Jun 25 18:10:36 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:36 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.992s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:10:36 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Deleted volume successfully. Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-de9444f8-6d8c-4cff-9dc0-09d3199928c7 tempest-ServersNegativeTestJSON-217570010 None] Lock "cinder-5ddeed10-f9ee-4a38-a45d-9ee37690d47a-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:36 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960" returned: 0 in 1.108s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:36 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960 Jun 25 18:10:36 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:37 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a" returned: 0 in 1.012s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:37 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a Jun 25 18:10:37 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:37 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6.8b155e04-f62e-4677-8239-31601531a960" returned: 0 in 0.750s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-8b155e04-f62e-4677-8239-31601531a960" released by "_delete_snapshot" :: held 4.149s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-97453606-f130-4763-9ad1-2fe38f6655b6" released by "delete_snapshot" :: held 4.207s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Created reservations ['a600311b-a5bd-4462-9394-48402e75c47d', '51822de7-d116-4a69-9958-76eaebd03cda', 'b4829c06-7c6c-484f-bf50-c9f40bbf2146', '88aed8f6-893a-4ac8-9d03-6bcf6e0a92ef'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Delete snapshot completed successfully. Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-8b155e04-f62e-4677-8239-31601531a960-delete_snapshot" released by "delete_snapshot" :: held 4.472s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Snapshots deleted, issuing volume delete {{(pid=93767) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1046}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-97453606-f130-4763-9ad1-2fe38f6655b6" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-97453606-f130-4763-9ad1-2fe38f6655b6" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f8c3c8-513b-4d7e-a5e7-355c29af32ab]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:37 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1bb60bf3-339d-4762-9044-a9d05b8cde7a" returned: 0 in 0.707s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:37 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 Jun 25 18:10:37 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Lock "cinder-quobyte-1bb60bf3-339d-4762-9044-a9d05b8cde7a" released by "delete_volume" :: held 1.787s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:37 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Created reservations ['33d20cc3-2c96-487a-a0dc-872bc9bb6ccb', '1290b4e9-2e28-4a37-b7a5-dc384f0ac3df', 'd354b08e-384c-4a32-9177-139ec1a0a055', 'aab4247d-6cff-4e5b-8b01-7c2fd0af2a17'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:38 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:10:38 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:38 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6" returned: 0 in 1.122s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:38 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6 Jun 25 18:10:38 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:38 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.831s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:10:38 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Deleted volume successfully. Jun 25 18:10:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f66556ab-8523-4d30-8967-00d1832cdd5e tempest-ServersNegativeTestJSON-217570010 None] Lock "cinder-1bb60bf3-339d-4762-9044-a9d05b8cde7a-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:40 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-97453606-f130-4763-9ad1-2fe38f6655b6" returned: 0 in 1.133s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-97453606-f130-4763-9ad1-2fe38f6655b6" released by "delete_volume" :: held 2.356s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Created reservations ['c01a96aa-d589-4580-9285-2c467c9ed9a7', '2b7a974e-5cd4-4331-b00e-a28e59eec36c', '48707421-94dc-4ce6-8271-bda58f24e2e7', '9098c1c4-c6d0-4196-b5bb-d08c0f22cce5'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:40 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:10:40 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:40 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:10:40 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:41 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.118s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:10:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:10:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 8 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:10:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:10:41 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.361s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:10:41 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Deleted volume successfully. Jun 25 18:10:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a209b02d-bfe1-4f11-91f0-f8a5f1a76a4c tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-97453606-f130-4763-9ad1-2fe38f6655b6-delete_volume" released by "delete_volume" :: held 17.269s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Flow 'volume_create_manager' (4eea3f68-1fe4-4646-94ba-edb52b3bdb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c213e10-5bc9-4a99-bcfd-b02db24aa73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c213e10-5bc9-4a99-bcfd-b02db24aa73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1579866103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a1c1eb-12a4-4f5f-8305-1bdf57d14646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5a091f69304dbd88e956ae55a96e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:43Z,use_quota=True,user_id='616e1161a8b645dcb155aaa5b2e00562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747e0b0a-72fe-4dc7-be0d-22474120febe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747e0b0a-72fe-4dc7-be0d-22474120febe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d74b8a-bfc2-410d-bf23-edbc28916e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d74b8a-bfc2-410d-bf23-edbc28916e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a1c1eb-12a4-4f5f-8305-1bdf57d14646', 'volume_name': 'volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d241ab-f6fe-41ad-b005-72d23f9c1ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d241ab-f6fe-41ad-b005-72d23f9c1ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad66779-77d6-47c2-aa61-22040fcc9284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:42 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Volume a1a1c1eb-12a4-4f5f-8305-1bdf57d14646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646', 'volume_size': 1} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1579866103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a1c1eb-12a4-4f5f-8305-1bdf57d14646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5a091f69304dbd88e956ae55a96e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:43Z,use_quota=True,user_id='616e1161a8b645dcb155aaa5b2e00562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Creating volume a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:10:42 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:10:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:42 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 1073741824 Jun 25 18:10:42 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:43 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 1073741824" returned: 0 in 0.899s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:43 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 Jun 25 18:10:43 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:44 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" returned: 0 in 0.781s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:10:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad66779-77d6-47c2-aa61-22040fcc9284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb2a52a-4c77-4e12-b2b6-4618041762eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:44 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Volume volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 (a1a1c1eb-12a4-4f5f-8305-1bdf57d14646): created successfully Jun 25 18:10:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb2a52a-4c77-4e12-b2b6-4618041762eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Flow 'volume_create_manager' (4eea3f68-1fe4-4646-94ba-edb52b3bdb15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5dc01ad9-dc33-4b2e-ada7-791021d0824c tempest-VolumesDeleteCascade-1034476196 None] Created volume successfully. Jun 25 18:10:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Creating offline snapshot a4cb4395-2b17-433e-9f6c-ac56c040da33 of volume a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:10:46 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[098eb076-3508-4104-b7d4-8211fda5b432]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:46 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 Jun 25 18:10:46 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:47 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" returned: 0 in 1.144s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:47 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 1G Jun 25 18:10:47 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f9db9bbe-b612-451a-af9c-07d40361abf7 req-de89ef25-af18-40b2-9721-02240507e7a0 tempest-ServerActionsTestOtherA-94941714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:48 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 1G" returned: 0 in 1.242s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:48 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 Jun 25 18:10:48 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Acquiring lock "cinder-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Lock "cinder-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:49 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33" returned: 0 in 0.919s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:49 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 is being set with open permissions: ugo+rw Jun 25 18:10:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:49 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 Jun 25 18:10:49 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Acquiring lock "cinder-quobyte-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Lock "cinder-quobyte-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904" acquired by "delete_volume" :: waited 0.032s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:49 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83f88f7-bc60-4ad1-b554-80aee494c6f6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:49 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 Jun 25 18:10:49 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:50 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33" returned: 0 in 0.885s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:50 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.info Jun 25 18:10:50 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:50 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904" returned: 0 in 0.978s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:50 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904 Jun 25 18:10:50 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:51 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.info" returned: 0 in 0.812s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:51 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.info is being set with open permissions: ugo+rw Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:51 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.info Jun 25 18:10:51 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:51 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904" returned: 0 in 0.856s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Lock "cinder-quobyte-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904" released by "delete_volume" :: held 1.900s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Created reservations ['45278d2b-fded-4e13-9749-1161fddbc399', 'd6bd6ffd-30d5-43c9-a47e-1ec2e779c8bc', '9b38fa36-64ea-4ea3-8656-bbd39547afa1', 'ef0fe962-77be-4f3f-9157-d6d528ccd86a'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:51 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:10:51 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:51 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.info" returned: 0 in 0.811s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.949s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f9db9bbe-b612-451a-af9c-07d40361abf7 req-de89ef25-af18-40b2-9721-02240507e7a0 tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.730s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:52 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[15223662-2985-484c-8c78-bc186b711e1d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f9db9bbe-b612-451a-af9c-07d40361abf7 req-de89ef25-af18-40b2-9721-02240507e7a0 tempest-ServerActionsTestOtherA-94941714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:52 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b9028c4d-1cd0-4733-965d-933b2e2e9834 tempest-VolumesDeleteCascade-1034476196 None] Create snapshot completed successfully Jun 25 18:10:52 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 Jun 25 18:10:52 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:52 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.943s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:52 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:10:52 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Deleted volume successfully. Jun 25 18:10:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-869e037b-3412-4ca1-a4ae-52d367e6d91c tempest-TaggedAttachmentsTest-1518679089 None] Lock "cinder-1ff7838f-4f2c-4c8b-b7c1-f9ff12c53904-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:53 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f9db9bbe-b612-451a-af9c-07d40361abf7 req-de89ef25-af18-40b2-9721-02240507e7a0 tempest-ServerActionsTestOtherA-94941714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9" returned: 0 in 1.202s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f9db9bbe-b612-451a-af9c-07d40361abf7 req-de89ef25-af18-40b2-9721-02240507e7a0 tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.244s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-f9db9bbe-b612-451a-af9c-07d40361abf7 req-de89ef25-af18-40b2-9721-02240507e7a0 tempest-ServerActionsTestOtherA-94941714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-1aa1bacb-6205-4e79-90eb-9836378f28e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c17c2de-0ff6-42ed-afd1-68e0c1ee480b', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:10:53 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-f9db9bbe-b612-451a-af9c-07d40361abf7 req-de89ef25-af18-40b2-9721-02240507e7a0 tempest-ServerActionsTestOtherA-94941714 None] attachment_update completed successfully. Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Flow 'volume_create_manager' (e5edeff7-e8b5-4481-af1b-b5f26511d5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aea354-7aef-47a0-987b-b11ae0a67a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aea354-7aef-47a0-987b-b11ae0a67a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-403739668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108ea8fd-33d2-43f3-b385-9f0ca0193683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5a091f69304dbd88e956ae55a96e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4cb4395-2b17-433e-9f6c-ac56c040da33,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:53Z,use_quota=True,user_id='616e1161a8b645dcb155aaa5b2e00562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4baca561-eb10-49ac-a2dd-98e75cc19534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4baca561-eb10-49ac-a2dd-98e75cc19534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329aa860-5238-4225-a607-a8a6095bc601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329aa860-5238-4225-a607-a8a6095bc601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '108ea8fd-33d2-43f3-b385-9f0ca0193683', 'volume_name': 'volume-108ea8fd-33d2-43f3-b385-9f0ca0193683', 'volume_size': 1, 'snapshot_id': 'a4cb4395-2b17-433e-9f6c-ac56c040da33'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f67771-390e-4463-98f6-d4b5de44cfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f67771-390e-4463-98f6-d4b5de44cfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfd1280-a848-415a-8f4d-0b0ca3a598a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:53 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Volume 108ea8fd-33d2-43f3-b385-9f0ca0193683: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-108ea8fd-33d2-43f3-b385-9f0ca0193683', 'volume_size': 1, 'snapshot_id': 'a4cb4395-2b17-433e-9f6c-ac56c040da33'} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-a4cb4395-2b17-433e-9f6c-ac56c040da33-108ea8fd-33d2-43f3-b385-9f0ca0193683" by "_create_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-a4cb4395-2b17-433e-9f6c-ac56c040da33-108ea8fd-33d2-43f3-b385-9f0ca0193683" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Creating volume 108ea8fd-33d2-43f3-b385-9f0ca0193683 from snapshot a4cb4395-2b17-433e-9f6c-ac56c040da33 {{(pid=93767) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-108ea8fd-33d2-43f3-b385-9f0ca0193683" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-108ea8fd-33d2-43f3-b385-9f0ca0193683" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] snapshot: a4cb4395-2b17-433e-9f6c-ac56c040da33, volume: 108ea8fd-33d2-43f3-b385-9f0ca0193683, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=66,cinder:UPDATE=66,cinder:INSERT=21,cinder:DELETE=5 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[150ebb47-eaff-45cf-b1a0-9e31d27806fd]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:54 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 Jun 25 18:10:54 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:55 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33" returned: 0 in 1.278s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:10:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:10:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:10:55 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d93c453-8387-4b32-aa50-b9b1ee3fc42f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:55 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 Jun 25 18:10:55 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:56 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" returned: 0 in 1.038s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:56 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:10:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:56 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 Jun 25 18:10:56 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=67,cinder:SELECT=63,cinder:INSERT=10,cinder:DELETE=7 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Flow 'volume_create_manager' (842bd9d8-f4bf-4094-be41-51236a81156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3298a078-c55b-400a-9103-6d19d39a712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3298a078-c55b-400a-9103-6d19d39a712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-557591592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6fb1ea-a845-4929-a504-0f69077984e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5236de6c05445568b9b9a97e9262bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:03Z,use_quota=True,user_id='b734b027496f43b0b528ccb4c6a139c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dca859-0a63-40d8-a3ac-6e2fe97f126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dca859-0a63-40d8-a3ac-6e2fe97f126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfa97fc-10d2-4e65-977f-49d637f44437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfa97fc-10d2-4e65-977f-49d637f44437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6fb1ea-a845-4929-a504-0f69077984e3', 'volume_name': 'volume-9d6fb1ea-a845-4929-a504-0f69077984e3', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250693a8-8e70-40dc-9c84-cdab4f8bac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250693a8-8e70-40dc-9c84-cdab4f8bac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064bec1f-a626-49b3-90de-9700ccdfdf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:03 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Volume 9d6fb1ea-a845-4929-a504-0f69077984e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6fb1ea-a845-4929-a504-0f69077984e3', 'volume_size': 1} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:03 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683" returned: 0 in 7.545s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c21b3a-7b78-48ae-b6cc-5ef830961ec4]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:03 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 Jun 25 18:11:03 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-c8074d5a-461c-40b8-b009-6cd368a91e51 req-650cfc1e-4833-45f9-86c0-a80e1caadae9 tempest-ServerActionsTestOtherA-94941714 None] Terminate volume connection completed successfully. Jun 25 18:11:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-c8074d5a-461c-40b8-b009-6cd368a91e51 req-650cfc1e-4833-45f9-86c0-a80e1caadae9 tempest-ServerActionsTestOtherA-94941714 None] Deleting attachment 3c17c2de-0ff6-42ed-afd1-68e0c1ee480b. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:11:05 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" returned: 0 in 1.272s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:11:05 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Converted 1024.00 MB image at 135.59 MB/s Jun 25 18:11:05 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 is being set with open permissions: ugo+rw Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:05 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 Jun 25 18:11:05 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:05 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683" returned: 0 in 0.783s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-108ea8fd-33d2-43f3-b385-9f0ca0193683" released by "_copy_volume_from_snapshot" :: held 12.106s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-a4cb4395-2b17-433e-9f6c-ac56c040da33-108ea8fd-33d2-43f3-b385-9f0ca0193683" released by "_create_volume_from_snapshot" :: held 12.146s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.165s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.125s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-557591592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6fb1ea-a845-4929-a504-0f69077984e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5236de6c05445568b9b9a97e9262bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:03Z,use_quota=True,user_id='b734b027496f43b0b528ccb4c6a139c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Creating volume 9d6fb1ea-a845-4929-a504-0f69077984e3 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:05 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:05 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 1073741824 Jun 25 18:11:05 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfd1280-a848-415a-8f4d-0b0ca3a598a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108ea8fd-33d2-43f3-b385-9f0ca0193683', 'volume_size': 1, 'snapshot_id': 'a4cb4395-2b17-433e-9f6c-ac56c040da33'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72544de3-6602-4737-8eae-b8e8438d0fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:05 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Volume volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 (108ea8fd-33d2-43f3-b385-9f0ca0193683): created successfully Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72544de3-6602-4737-8eae-b8e8438d0fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Flow 'volume_create_manager' (e5edeff7-e8b5-4481-af1b-b5f26511d5b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:06 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c8793082-8a64-4636-a8f1-4c8bf16513ec tempest-VolumesDeleteCascade-1034476196 None] Created volume successfully. Jun 25 18:11:07 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 1073741824" returned: 0 in 1.270s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-c8074d5a-461c-40b8-b009-6cd368a91e51 req-55a6a701-fede-4438-a768-519f78ea8fe2 tempest-ServerActionsTestOtherA-94941714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:07 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 Jun 25 18:11:07 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Performing cascade delete. {{(pid=93767) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1031}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-a4cb4395-2b17-433e-9f6c-ac56c040da33-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-a4cb4395-2b17-433e-9f6c-ac56c040da33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-a4cb4395-2b17-433e-9f6c-ac56c040da33" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-a4cb4395-2b17-433e-9f6c-ac56c040da33" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Deleting offline snapshot a4cb4395-2b17-433e-9f6c-ac56c040da33 of volume a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] snapshot_file for this snap is: volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a57766-6b80-4355-8df4-40c7dee86969]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:07 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 Jun 25 18:11:07 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:08 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3" returned: 0 in 1.060s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] <== create_volume: return (2388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.390s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-c8074d5a-461c-40b8-b009-6cd368a91e51 req-55a6a701-fede-4438-a768-519f78ea8fe2 tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.101s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064bec1f-a626-49b3-90de-9700ccdfdf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6fb1ea-a845-4929-a504-0f69077984e3', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a89833-5dcc-47aa-b909-b72e04dd31c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10fda5e-e302-4eb1-a3be-f7b23a1fb41f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c8074d5a-461c-40b8-b009-6cd368a91e51 req-55a6a701-fede-4438-a768-519f78ea8fe2 tempest-ServerActionsTestOtherA-94941714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:08 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Volume volume-9d6fb1ea-a845-4929-a504-0f69077984e3 (9d6fb1ea-a845-4929-a504-0f69077984e3): created successfully Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a89833-5dcc-47aa-b909-b72e04dd31c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Flow 'volume_create_manager' (842bd9d8-f4bf-4094-be41-51236a81156a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:08 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-a99be340-462b-4737-a153-5c21b2e65ddd req-005ecacb-1313-40a4-a1cf-1ca2e1451c6e tempest-VolumesSnapshotsTestJSON-272312812 None] Created volume successfully. Jun 25 18:11:08 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 Jun 25 18:11:08 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:08 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33" returned: 0 in 1.125s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1752e7-b410-4ae2-9152-411045a6fb85]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:08 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 Jun 25 18:11:08 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:09 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c8074d5a-461c-40b8-b009-6cd368a91e51 req-55a6a701-fede-4438-a768-519f78ea8fe2 tempest-ServerActionsTestOtherA-94941714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9" returned: 0 in 0.967s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-c8074d5a-461c-40b8-b009-6cd368a91e51 req-55a6a701-fede-4438-a768-519f78ea8fe2 tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.020s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-c8074d5a-461c-40b8-b009-6cd368a91e51 req-55a6a701-fede-4438-a768-519f78ea8fe2 tempest-ServerActionsTestOtherA-94941714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-1aa1bacb-6205-4e79-90eb-9836378f28e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e7a25e4-e1ac-49a3-b42d-06760c26b6d9', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:11:09 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-c8074d5a-461c-40b8-b009-6cd368a91e51 req-55a6a701-fede-4438-a768-519f78ea8fe2 tempest-ServerActionsTestOtherA-94941714 None] attachment_update completed successfully. Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Creating offline snapshot 5a4e763a-24a4-43de-8c0b-8d37eb338bed of volume 9d6fb1ea-a845-4929-a504-0f69077984e3 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ca74a5-6a92-4b7a-a00d-003d4cb69468]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:09 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" returned: 0 in 1.146s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:09 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 Jun 25 18:11:09 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:09 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 Jun 25 18:11:09 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:10 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33" returned: 0 in 1.027s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:10 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33 Jun 25 18:11:10 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:10 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3" returned: 0 in 1.139s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:10 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed 1G Jun 25 18:11:10 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:11 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646.a4cb4395-2b17-433e-9f6c-ac56c040da33" returned: 0 in 0.954s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-a4cb4395-2b17-433e-9f6c-ac56c040da33" released by "_delete_snapshot" :: held 4.367s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" released by "delete_snapshot" :: held 4.393s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:11 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Created reservations ['a70e1142-8b44-492e-8c9b-202bae6ac919', 'beac71ab-504a-46f6-b647-632f0166e6e8', 'ea0135fb-3b0b-4c3a-a70c-4e0825da595e', '3d063f5a-d8f1-4d4b-9c9f-72319c15a1b3'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:12 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Delete snapshot completed successfully. Jun 25 18:11:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-a4cb4395-2b17-433e-9f6c-ac56c040da33-delete_snapshot" released by "delete_snapshot" :: held 4.599s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Snapshots deleted, issuing volume delete {{(pid=93767) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1046}} Jun 25 18:11:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[021ebd3e-460e-41ef-be04-883547444317]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:12 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 Jun 25 18:11:12 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:12 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed 1G" returned: 0 in 1.417s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6fb1ea-a845-4929-a504-0f69077984e3 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:12 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6fb1ea-a845-4929-a504-0f69077984e3 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed Jun 25 18:11:12 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:13 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" returned: 0 in 1.116s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:13 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646 Jun 25 18:11:13 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:13 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6fb1ea-a845-4929-a504-0f69077984e3 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed" returned: 0 in 0.987s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:13 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed is being set with open permissions: ugo+rw Jun 25 18:11:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:13 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed Jun 25 18:11:13 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:14 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" returned: 0 in 0.883s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646" released by "delete_volume" :: held 2.107s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Created reservations ['9073d5ab-b913-4873-96cd-204338feb8fe', 'd827747b-67be-44a0-b537-7fd8defe16b1', 'fa1b7707-d53e-4327-a0f5-59c3fa6234cd', '36bfd936-7c37-4abb-aff2-b307038dbb15'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:14 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed" returned: 0 in 0.940s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:14 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.info Jun 25 18:11:14 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:14 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:11:14 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:15 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.info" returned: 0 in 0.851s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:15 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.info is being set with open permissions: ugo+rw Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:15 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.info Jun 25 18:11:15 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:15 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.854s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:15 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Deleted volume successfully. Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6b948fc9-0f6c-4327-8d3f-9f0931c97f8d tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-a1a1c1eb-12a4-4f5f-8305-1bdf57d14646-delete_volume" released by "delete_volume" :: held 7.934s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-108ea8fd-33d2-43f3-b385-9f0ca0193683-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-108ea8fd-33d2-43f3-b385-9f0ca0193683-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "cinder-quobyte-108ea8fd-33d2-43f3-b385-9f0ca0193683" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-108ea8fd-33d2-43f3-b385-9f0ca0193683" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7e0415-9faa-4235-9fb4-62a879e08d78]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:15 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 Jun 25 18:11:15 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:16 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.info" returned: 0 in 1.054s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.528s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:16 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-c1306c69-fb2f-4739-9376-8bcde106c525 req-35f7c39f-e380-411e-be94-667d376956a8 tempest-VolumesSnapshotsTestJSON-272312812 None] Create snapshot completed successfully Jun 25 18:11:16 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683" returned: 0 in 1.138s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:16 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683 Jun 25 18:11:16 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Acquiring lock "cinder-5a4e763a-24a4-43de-8c0b-8d37eb338bed-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-5a4e763a-24a4-43de-8c0b-8d37eb338bed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Acquiring lock "cinder-quobyte-9d6fb1ea-a845-4929-a504-0f69077984e3" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-quobyte-9d6fb1ea-a845-4929-a504-0f69077984e3" acquired by "delete_snapshot" :: waited 0.057s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Acquiring lock "cinder-quobyte-5a4e763a-24a4-43de-8c0b-8d37eb338bed" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-quobyte-5a4e763a-24a4-43de-8c0b-8d37eb338bed" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Deleting offline snapshot 5a4e763a-24a4-43de-8c0b-8d37eb338bed of volume 9d6fb1ea-a845-4929-a504-0f69077984e3 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:11:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] snapshot_file for this snap is: volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:11:17 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccccfff-074f-4ce4-9c5a-d22c8da8e3c6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:17 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed Jun 25 18:11:17 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:17 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-108ea8fd-33d2-43f3-b385-9f0ca0193683" returned: 0 in 1.165s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-quobyte-108ea8fd-33d2-43f3-b385-9f0ca0193683" released by "delete_volume" :: held 2.367s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Created reservations ['adff772c-131f-4964-9500-3258b5f49f46', '0c4b8ac9-29ee-4015-9a95-7d97edf85bbe', '9cae1447-ba76-4e3b-b360-318392321528', 'ee3eebb0-729d-4a06-8cf7-87e63ec07ea8'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:18 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed" returned: 0 in 1.146s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d6fb1ea-a845-4929-a504-0f69077984e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:11:18 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:11:18 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8892a3-a0a9-4d6d-b8d1-8c9d69ec3a8e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:18 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 Jun 25 18:11:18 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:19 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3" returned: 0 in 1.504s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:19 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.643s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:19 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed Jun 25 18:11:19 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:19 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:19 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Deleted volume successfully. Jun 25 18:11:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-993a81a3-077a-4b26-aa32-d9ce16db9b04 tempest-VolumesDeleteCascade-1034476196 None] Lock "cinder-108ea8fd-33d2-43f3-b385-9f0ca0193683-delete_volume" released by "delete_volume" :: held 4.462s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:21 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed" returned: 0 in 1.454s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:21 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed Jun 25 18:11:21 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:22 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3.5a4e763a-24a4-43de-8c0b-8d37eb338bed" returned: 0 in 1.623s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-quobyte-5a4e763a-24a4-43de-8c0b-8d37eb338bed" released by "_delete_snapshot" :: held 5.951s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-quobyte-9d6fb1ea-a845-4929-a504-0f69077984e3" released by "delete_snapshot" :: held 6.009s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:23 devstack cinder-volume[93767]: DEBUG cinder.quota [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Created reservations ['ea6461d0-66b2-4d28-a269-5ab4973e971d', '68a93a33-2f33-48f4-8897-5109c6f8d2ac', 'c6927beb-5b13-4f39-8d78-4e5c5b363322', '7f89087a-00f1-4d12-9e9c-ed16832e4882'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Delete snapshot completed successfully. Jun 25 18:11:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-08dba115-ecad-4694-81cb-d2373c6fb179 req-1c159a1b-bfab-40bf-a3e7-08ef58c9d13e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-5a4e763a-24a4-43de-8c0b-8d37eb338bed-delete_snapshot" released by "delete_snapshot" :: held 6.269s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Acquiring lock "cinder-9d6fb1ea-a845-4929-a504-0f69077984e3-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-9d6fb1ea-a845-4929-a504-0f69077984e3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Acquiring lock "cinder-quobyte-9d6fb1ea-a845-4929-a504-0f69077984e3" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-quobyte-9d6fb1ea-a845-4929-a504-0f69077984e3" acquired by "delete_volume" :: waited 0.047s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:24 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[3086e4e2-028d-4eba-86cb-2b89eeca5d6e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:24 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 Jun 25 18:11:24 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Flow 'volume_create_manager' (1438440b-e834-440e-a4fd-6509bf22d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba2aa5d-de00-43e9-a09a-c0bb1a435bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba2aa5d-de00-43e9-a09a-c0bb1a435bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1646426348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ba211d-6031-4e82-a4eb-267a35089445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cafbdafb2b24cd5981423996ac62e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:25Z,use_quota=True,user_id='ba9ef28241574def92cd050a7269c899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ba78a0-4337-4b9e-8ee2-b8e7252ba710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ba78a0-4337-4b9e-8ee2-b8e7252ba710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96dff7a1-bff1-439f-9c23-361f53b3db30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96dff7a1-bff1-439f-9c23-361f53b3db30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ba211d-6031-4e82-a4eb-267a35089445', 'volume_name': 'volume-53ba211d-6031-4e82-a4eb-267a35089445', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45184c21-2fd3-45a0-a856-6a25523f2c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45184c21-2fd3-45a0-a856-6a25523f2c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b45b89e-a9ca-4ba3-bd2c-3272db16778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:25 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Volume 53ba211d-6031-4e82-a4eb-267a35089445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ba211d-6031-4e82-a4eb-267a35089445', 'volume_size': 1} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1646426348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ba211d-6031-4e82-a4eb-267a35089445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cafbdafb2b24cd5981423996ac62e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:25Z,use_quota=True,user_id='ba9ef28241574def92cd050a7269c899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Creating volume 53ba211d-6031-4e82-a4eb-267a35089445 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:25 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:11:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:25 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445 1073741824 Jun 25 18:11:25 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:26 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3" returned: 0 in 1.857s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:26 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3 Jun 25 18:11:26 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:26 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445 1073741824" returned: 0 in 1.469s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:26 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445 Jun 25 18:11:26 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:27 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9d6fb1ea-a845-4929-a504-0f69077984e3" returned: 0 in 1.139s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-quobyte-9d6fb1ea-a845-4929-a504-0f69077984e3" released by "delete_volume" :: held 3.155s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:27 devstack cinder-volume[93767]: DEBUG cinder.quota [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Created reservations ['e0264c2c-0df3-4636-b99b-82482a488d18', 'a28cccdf-3524-40a3-bee3-15343e964ed5', '0360682a-623d-4970-91e8-16a47716c06e', 'f1849821-4e62-4d90-8bd1-c66dc3be4b2a'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:27 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:11:27 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:28 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445" returned: 0 in 1.360s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] <== create_volume: return (2929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.932s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b45b89e-a9ca-4ba3-bd2c-3272db16778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ba211d-6031-4e82-a4eb-267a35089445', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2237ae4c-99ad-48c2-96e0-47b4dbc48c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:28 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Volume volume-53ba211d-6031-4e82-a4eb-267a35089445 (53ba211d-6031-4e82-a4eb-267a35089445): created successfully Jun 25 18:11:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2237ae4c-99ad-48c2-96e0-47b4dbc48c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Flow 'volume_create_manager' (1438440b-e834-440e-a4fd-6509bf22d212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:28 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6ae6b612-c87e-40e2-b40c-708c0380bf9d tempest-VolumesMetadataTest-1053303796 None] Created volume successfully. Jun 25 18:11:29 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.464s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:29 devstack cinder-volume[93767]: DEBUG cinder.manager [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Deleted volume successfully. Jun 25 18:11:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-4c70d8d7-bcc9-4ecf-954c-da0e0f664348 req-883bfb7d-2610-49ec-9883-8d20608a879e tempest-VolumesSnapshotsTestJSON-272312812 None] Lock "cinder-9d6fb1ea-a845-4929-a504-0f69077984e3-delete_volume" released by "delete_volume" :: held 5.128s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Acquiring lock "cinder-53ba211d-6031-4e82-a4eb-267a35089445-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Lock "cinder-53ba211d-6031-4e82-a4eb-267a35089445-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Acquiring lock "cinder-quobyte-53ba211d-6031-4e82-a4eb-267a35089445" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Lock "cinder-quobyte-53ba211d-6031-4e82-a4eb-267a35089445" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:30 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ce6d72-671f-450e-82f2-703fc9c33de1]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:30 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445 Jun 25 18:11:30 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:31 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445" returned: 0 in 1.376s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:31 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445 Jun 25 18:11:31 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:32 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-53ba211d-6031-4e82-a4eb-267a35089445" returned: 0 in 0.921s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Lock "cinder-quobyte-53ba211d-6031-4e82-a4eb-267a35089445" released by "delete_volume" :: held 2.355s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:32 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Created reservations ['94a579f3-83f8-4230-9389-dd2a01cf77ec', '1bb2cfb5-c202-4501-93c3-3f40105cb62d', '15ac6a76-57c5-4728-b704-91017e41d9a0', 'ca38468f-ca0a-43c7-ab91-1f0cf7e7e1c8'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:32 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:11:32 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:33 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.986s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:33 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:33 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Deleted volume successfully. Jun 25 18:11:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19066c8a-e531-4121-b8e8-c41920159443 tempest-VolumesMetadataTest-1053303796 None] Lock "cinder-53ba211d-6031-4e82-a4eb-267a35089445-delete_volume" released by "delete_volume" :: held 3.653s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-92386f50-387a-4da0-b247-bb0a107c1d58 tempest-GroupsV320Test-1489453685 None] Group tempest-GroupsV320Test-Group-992282643: creating Jun 25 18:11:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-92386f50-387a-4da0-b247-bb0a107c1d58 tempest-GroupsV320Test-1489453685 None] Group tempest-GroupsV320Test-Group-992282643: created successfully Jun 25 18:11:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-92386f50-387a-4da0-b247-bb0a107c1d58 tempest-GroupsV320Test-1489453685 None] Create group completed successfully. Jun 25 18:11:36 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] Created reservations ['5f2c1975-ef39-4459-8cf9-5908039e4736'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:36 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:11:36 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:37 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.754s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:37 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d99e061d-07c2-4ea1-8658-461c220168e7 tempest-GroupsV320Test-1489453685 None] Delete group completed successfully. Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Flow 'volume_create_manager' (1f0d1b31-fd94-4288-be04-c1c5393c069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2004cced-9a0e-42d5-98c0-ec6d2c3aadc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2004cced-9a0e-42d5-98c0-ec6d2c3aadc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1309186592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28233de5-957e-4e46-bd31-5c6e987d8ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0de26cdc2f4fecab0886e99d2415c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:39Z,use_quota=True,user_id='711641edeb104e3e93383d7dda640f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb74138-8eb7-4ba9-b486-a6cd7947b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb74138-8eb7-4ba9-b486-a6cd7947b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5be12a-7d4d-44fe-96f1-1b66c79aec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5be12a-7d4d-44fe-96f1-1b66c79aec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28233de5-957e-4e46-bd31-5c6e987d8ac7', 'volume_name': 'volume-28233de5-957e-4e46-bd31-5c6e987d8ac7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a883f5a1-1781-40f3-8fc2-35fd993a08f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a883f5a1-1781-40f3-8fc2-35fd993a08f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fcd3e1-5ba5-4e51-921d-7ad487020b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Volume 28233de5-957e-4e46-bd31-5c6e987d8ac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28233de5-957e-4e46-bd31-5c6e987d8ac7', 'volume_size': 1} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1309186592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28233de5-957e-4e46-bd31-5c6e987d8ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0de26cdc2f4fecab0886e99d2415c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:39Z,use_quota=True,user_id='711641edeb104e3e93383d7dda640f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Creating volume 28233de5-957e-4e46-bd31-5c6e987d8ac7 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:39 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:11:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:39 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 1073741824 Jun 25 18:11:39 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:11:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:40 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:11:40 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:40 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 1073741824" returned: 0 in 1.352s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:40 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 Jun 25 18:11:40 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:41 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.187s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 8 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:11:41 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7" returned: 0 in 0.864s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fcd3e1-5ba5-4e51-921d-7ad487020b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28233de5-957e-4e46-bd31-5c6e987d8ac7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf53a50-2ea6-4a22-bcea-969ffb84d3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:41 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Volume volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 (28233de5-957e-4e46-bd31-5c6e987d8ac7): created successfully Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf53a50-2ea6-4a22-bcea-969ffb84d3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Flow 'volume_create_manager' (1f0d1b31-fd94-4288-be04-c1c5393c069e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:41 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1d9f6590-a62c-42f0-8304-40239423391d tempest-VolumesTransfersV355Test-599010714 None] Created volume successfully. Jun 25 18:11:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8a2a10f8-7af9-4ee3-945b-46a49576e8e9 tempest-VolumesTransfersV355Test-1531284563 None] Transfer volume completed successfully. Jun 25 18:11:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Acquiring lock "cinder-28233de5-957e-4e46-bd31-5c6e987d8ac7-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Lock "cinder-28233de5-957e-4e46-bd31-5c6e987d8ac7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Acquiring lock "cinder-quobyte-28233de5-957e-4e46-bd31-5c6e987d8ac7" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Lock "cinder-quobyte-28233de5-957e-4e46-bd31-5c6e987d8ac7" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:45 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ddf908-a263-448c-b6f2-fdf88860d57a]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:45 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 Jun 25 18:11:45 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:46 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-6a63f8e0-c82e-423b-99e6-0a3cda778508 req-b5b8508d-4fe3-4b2c-9d19-77de6b390ec4 tempest-ServerActionsTestOtherA-94941714 None] Terminate volume connection completed successfully. Jun 25 18:11:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-6a63f8e0-c82e-423b-99e6-0a3cda778508 req-b5b8508d-4fe3-4b2c-9d19-77de6b390ec4 tempest-ServerActionsTestOtherA-94941714 None] Deleting attachment 8e7a25e4-e1ac-49a3-b42d-06760c26b6d9. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:11:46 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7" returned: 0 in 1.071s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:46 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7 Jun 25 18:11:46 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:47 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-28233de5-957e-4e46-bd31-5c6e987d8ac7" returned: 0 in 0.720s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:47 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Lock "cinder-quobyte-28233de5-957e-4e46-bd31-5c6e987d8ac7" released by "delete_volume" :: held 1.882s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:47 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Created reservations ['98c32992-3761-4e2e-a5ce-fad31f653570', '671cb9cc-8bcc-4b1d-8c85-16437ba8b9be', 'cb1eebc3-1c94-4a8d-9bd5-54eacdabcdb7', '5917793c-d797-4e90-9049-51ff24492492'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:47 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:11:47 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:48 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Flow 'volume_create_manager' (34d67348-60b7-4492-ada9-e8dd6bb794ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed9f652-7c96-4e9a-a081-ce02e01505af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.085s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed9f652-7c96-4e9a-a081-ce02e01505af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1491050077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bef9766-aae2-43e8-96a8-0f16465477b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0de26cdc2f4fecab0886e99d2415c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:49Z,use_quota=True,user_id='711641edeb104e3e93383d7dda640f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65c1cb4-23eb-44c8-a436-74dac916b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65c1cb4-23eb-44c8-a436-74dac916b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc54ae5-0f2e-4cc9-8191-b4a111712347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc54ae5-0f2e-4cc9-8191-b4a111712347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bef9766-aae2-43e8-96a8-0f16465477b1', 'volume_name': 'volume-3bef9766-aae2-43e8-96a8-0f16465477b1', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f6176c-5635-4fa7-8cb7-cc532710a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f6176c-5635-4fa7-8cb7-cc532710a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc42e597-9276-4669-8241-390ef8e38143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Volume 3bef9766-aae2-43e8-96a8-0f16465477b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bef9766-aae2-43e8-96a8-0f16465477b1', 'volume_size': 1} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1491050077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bef9766-aae2-43e8-96a8-0f16465477b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0de26cdc2f4fecab0886e99d2415c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:49Z,use_quota=True,user_id='711641edeb104e3e93383d7dda640f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Creating volume 3bef9766-aae2-43e8-96a8-0f16465477b1 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:48 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:48 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Deleted volume successfully. Jun 25 18:11:48 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1 1073741824 Jun 25 18:11:48 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:48 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e1da8aaf-3d87-41c6-be4c-f59208a03bfd tempest-VolumesTransfersV355Test-1133742818 None] Lock "cinder-28233de5-957e-4e46-bd31-5c6e987d8ac7-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:50 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1 1073741824" returned: 0 in 1.523s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:50 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1 Jun 25 18:11:50 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:51 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1" returned: 0 in 1.003s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] <== create_volume: return (2640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.644s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc42e597-9276-4669-8241-390ef8e38143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bef9766-aae2-43e8-96a8-0f16465477b1', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d66883-22de-42a0-9e50-7b07c1962049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:51 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Volume volume-3bef9766-aae2-43e8-96a8-0f16465477b1 (3bef9766-aae2-43e8-96a8-0f16465477b1): created successfully Jun 25 18:11:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d66883-22de-42a0-9e50-7b07c1962049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Flow 'volume_create_manager' (34d67348-60b7-4492-ada9-e8dd6bb794ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f4bb3cf1-d5e3-49dd-aa14-d707456ce716 tempest-VolumesTransfersV355Test-599010714 None] Created volume successfully. Jun 25 18:11:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Acquiring lock "cinder-3bef9766-aae2-43e8-96a8-0f16465477b1-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Lock "cinder-3bef9766-aae2-43e8-96a8-0f16465477b1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Acquiring lock "cinder-quobyte-3bef9766-aae2-43e8-96a8-0f16465477b1" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Lock "cinder-quobyte-3bef9766-aae2-43e8-96a8-0f16465477b1" acquired by "delete_volume" :: waited 0.040s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:53 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc7c0db-ce19-4392-a7f1-d71487889b10]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:53 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1 Jun 25 18:11:53 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:54 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1" returned: 0 in 1.594s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:54 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1 Jun 25 18:11:54 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:55 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3bef9766-aae2-43e8-96a8-0f16465477b1" returned: 0 in 1.026s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Lock "cinder-quobyte-3bef9766-aae2-43e8-96a8-0f16465477b1" released by "delete_volume" :: held 2.703s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:55 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=69,cinder:UPDATE=72,cinder:INSERT=17,cinder:DELETE=3 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:11:56 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Created reservations ['b0045e12-64aa-43ef-971d-4812c7e36969', '69576150-e4c8-4ca7-a1a3-b948a2bdb285', '56d3cfa1-99e9-4d35-ae5c-005a8090c5ae', 'cca9a0fd-3116-43e3-b589-7c8324b59e94'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:56 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:11:56 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:58 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.987s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:58 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:58 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Deleted volume successfully. Jun 25 18:11:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7d3e1de7-fa62-4527-adae-8e4d094dde88 tempest-VolumesTransfersV355Test-1133742818 None] Lock "cinder-3bef9766-aae2-43e8-96a8-0f16465477b1-delete_volume" released by "delete_volume" :: held 5.196s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Acquiring lock "cinder-1aa1bacb-6205-4e79-90eb-9836378f28e9-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Lock "cinder-1aa1bacb-6205-4e79-90eb-9836378f28e9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Acquiring lock "cinder-quobyte-1aa1bacb-6205-4e79-90eb-9836378f28e9" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Lock "cinder-quobyte-1aa1bacb-6205-4e79-90eb-9836378f28e9" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:59 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0ec491-4ae9-476c-9951-3c7377d1b10a]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:59 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 Jun 25 18:11:59 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:00 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9" returned: 0 in 1.452s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:00 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9 Jun 25 18:12:00 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:01 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1aa1bacb-6205-4e79-90eb-9836378f28e9" returned: 0 in 0.881s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:01 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Lock "cinder-quobyte-1aa1bacb-6205-4e79-90eb-9836378f28e9" released by "delete_volume" :: held 2.437s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:01 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Created reservations ['84945c38-7642-4a71-abb2-0eefe60ccda3', 'dd147e52-df59-434a-87a4-d7fb7821cec8', 'b8cb6932-166f-4987-9935-bf85721eafd4', '7f42811d-5d0d-408d-95d3-619ed52d5b8c'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:01 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:12:01 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:03 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.487s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:03 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:12:03 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Deleted volume successfully. Jun 25 18:12:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a0d5004e-1615-41f8-a57d-c79e22e9847c tempest-ServerActionsTestOtherA-94941714 None] Lock "cinder-1aa1bacb-6205-4e79-90eb-9836378f28e9-delete_volume" released by "delete_volume" :: held 4.443s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=86,cinder:DELETE=8,cinder:SELECT=73,cinder:INSERT=21 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Flow 'volume_create_manager' (3be39349-926c-4fa8-b5ba-3ac363db1cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8268609-df3f-4e6f-a295-9cb4e9d9a8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8268609-df3f-4e6f-a295-9cb4e9d9a8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-802875286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d344b0b-dcc9-4d65-b974-0c9bca07a404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20967c631454440b945fcab8686f47f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:08Z,use_quota=True,user_id='49395a4d2b9346dc9fbe530f3ce11622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b164f72e-5d29-4ddb-b688-e0b40d9f78a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b164f72e-5d29-4ddb-b688-e0b40d9f78a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1de5bbe-08d2-409c-b479-79c7f72f9836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1de5bbe-08d2-409c-b479-79c7f72f9836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d344b0b-dcc9-4d65-b974-0c9bca07a404', 'volume_name': 'volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4acd0d-3689-4750-ba43-3452c57ddbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4acd0d-3689-4750-ba43-3452c57ddbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ccfba9-e5c0-4c22-ae20-5bc226291a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:08 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Volume 0d344b0b-dcc9-4d65-b974-0c9bca07a404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404', 'volume_size': 1} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-802875286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d344b0b-dcc9-4d65-b974-0c9bca07a404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20967c631454440b945fcab8686f47f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:08Z,use_quota=True,user_id='49395a4d2b9346dc9fbe530f3ce11622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Creating volume 0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:12:08 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:12:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:08 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 1073741824 Jun 25 18:12:08 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:09 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 1073741824" returned: 0 in 1.091s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:09 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 Jun 25 18:12:09 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Flow 'volume_create_manager' (b0480598-4d89-4108-93f6-435745b40ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d16725-9624-457c-ad71-a86746de22a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d16725-9624-457c-ad71-a86746de22a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-118606373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6606e0c2-a6da-48c1-a588-993d4ab6f4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4fc88ea3fca43458b26c8cb5efbee47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:10Z,use_quota=True,user_id='fb53cfcb893449e69fc8d9bbd8b8c8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b40540-8b05-4779-a890-bc53680b5c78),volume_type_id=62b40540-8b05-4779-a890-bc53680b5c78)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516d8804-278e-461e-90a7-8dbfe6e8aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516d8804-278e-461e-90a7-8dbfe6e8aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807616d8-f8d0-4483-aa6f-c81fd808c172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807616d8-f8d0-4483-aa6f-c81fd808c172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6606e0c2-a6da-48c1-a588-993d4ab6f4fc', 'volume_name': 'volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b5ea56-822e-4328-a01a-8e0b3d51593d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b5ea56-822e-4328-a01a-8e0b3d51593d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ce47e3-4ac5-438c-8c66-2ce864550fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:09 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Volume 6606e0c2-a6da-48c1-a588-993d4ab6f4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc', 'volume_size': 1} Jun 25 18:12:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:10 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404" returned: 0 in 0.772s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.363s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-118606373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6606e0c2-a6da-48c1-a588-993d4ab6f4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4fc88ea3fca43458b26c8cb5efbee47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:10Z,use_quota=True,user_id='fb53cfcb893449e69fc8d9bbd8b8c8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b40540-8b05-4779-a890-bc53680b5c78),volume_type_id=62b40540-8b05-4779-a890-bc53680b5c78)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Creating volume 6606e0c2-a6da-48c1-a588-993d4ab6f4fc {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:12:10 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:10 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc 1073741824 Jun 25 18:12:10 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ccfba9-e5c0-4c22-ae20-5bc226291a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14c1eeb-e78b-4560-be48-3fd1feda3b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:10 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Volume volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 (0d344b0b-dcc9-4d65-b974-0c9bca07a404): created successfully Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14c1eeb-e78b-4560-be48-3fd1feda3b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Flow 'volume_create_manager' (3be39349-926c-4fa8-b5ba-3ac363db1cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ae5f4be1-27cf-4588-ab06-83af6a9bc82f tempest-VolumesCloneTest-1905524736 None] Created volume successfully. Jun 25 18:12:11 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc 1073741824" returned: 0 in 0.868s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:11 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc Jun 25 18:12:11 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:11 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc" returned: 0 in 0.699s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ce47e3-4ac5-438c-8c66-2ce864550fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209f7dce-7f23-48e7-bb39-86b40aaa5090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:11 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Volume volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc (6606e0c2-a6da-48c1-a588-993d4ab6f4fc): created successfully Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209f7dce-7f23-48e7-bb39-86b40aaa5090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Flow 'volume_create_manager' (b0480598-4d89-4108-93f6-435745b40ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Flow 'volume_create_manager' (bf82c7bd-e3de-4922-985b-ad2bdb7da6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d318e88a-ec43-45aa-ab8a-faea2c731d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:12 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b3b19b8e-d13a-4b40-9f6c-da45713a85e6 tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Created volume successfully. Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d318e88a-ec43-45aa-ab8a-faea2c731d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-555254756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20967c631454440b945fcab8686f47f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0d344b0b-dcc9-4d65-b974-0c9bca07a404,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:12Z,use_quota=True,user_id='49395a4d2b9346dc9fbe530f3ce11622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b6951c-b1bc-4c52-b0ec-f0800ecf8b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b6951c-b1bc-4c52-b0ec-f0800ecf8b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea7822d-f8df-4792-9fb5-68b16bee6085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea7822d-f8df-4792-9fb5-68b16bee6085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4', 'volume_name': 'volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4', 'volume_size': 2, 'source_volid': '0d344b0b-dcc9-4d65-b974-0c9bca07a404', 'source_volstatus': 'available'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4d9e1c-d14f-4a14-afed-4c11ad2f161a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4d9e1c-d14f-4a14-afed-4c11ad2f161a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321989bd-474c-4b66-9bf8-12f7ac527de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:12 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Volume 9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4', 'volume_size': 2, 'source_volid': '0d344b0b-dcc9-4d65-b974-0c9bca07a404', 'source_volstatus': 'available'} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:12 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Cloning volume 0d344b0b-dcc9-4d65-b974-0c9bca07a404 to volume 9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Creating offline snapshot 921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 of volume 0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1570e54-a133-480b-a548-f1155b91bdeb]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:12 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 Jun 25 18:12:12 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:13 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404" returned: 0 in 0.912s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:13 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 1G Jun 25 18:12:13 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-34f97332-b4f1-44ed-96e9-fca14956104b tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-34f97332-b4f1-44ed-96e9-fca14956104b tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-34f97332-b4f1-44ed-96e9-fca14956104b tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-34f97332-b4f1-44ed-96e9-fca14956104b tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-34f97332-b4f1-44ed-96e9-fca14956104b tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34f97332-b4f1-44ed-96e9-fca14956104b tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:13 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:12:13 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 1G" returned: 0 in 1.039s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:14 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:14 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 Jun 25 18:12:14 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:14 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-34f97332-b4f1-44ed-96e9-fca14956104b tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.779s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-34f97332-b4f1-44ed-96e9-fca14956104b tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:12:14 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-34f97332-b4f1-44ed-96e9-fca14956104b tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Retype volume completed successfully. Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Acquiring lock "cinder-6606e0c2-a6da-48c1-a588-993d4ab6f4fc-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "cinder-6606e0c2-a6da-48c1-a588-993d4ab6f4fc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Acquiring lock "cinder-quobyte-6606e0c2-a6da-48c1-a588-993d4ab6f4fc" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "cinder-quobyte-6606e0c2-a6da-48c1-a588-993d4ab6f4fc" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a35bf3-0914-4b1b-bd44-5fb9f88e133b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:15 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692" returned: 0 in 0.876s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:15 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 is being set with open permissions: ugo+rw Jun 25 18:12:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:15 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 Jun 25 18:12:15 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:15 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc Jun 25 18:12:15 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:15 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692" returned: 0 in 0.933s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:16 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:16 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.info Jun 25 18:12:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc" returned: 0 in 1.062s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:16 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:16 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc Jun 25 18:12:16 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:16 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6606e0c2-a6da-48c1-a588-993d4ab6f4fc" returned: 0 in 0.812s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "cinder-quobyte-6606e0c2-a6da-48c1-a588-993d4ab6f4fc" released by "delete_volume" :: held 1.969s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:16 devstack cinder-volume[93767]: WARNING cinder.quota [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:12:16 devstack cinder-volume[93767]: WARNING cinder.quota [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:12:16 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.info" returned: 0 in 0.979s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:16 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.info is being set with open permissions: ugo+rw Jun 25 18:12:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:17 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.info Jun 25 18:12:17 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:17 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Created reservations ['55124660-1cbb-4db8-93ce-3a809878d3ad', 'dbe9654d-66bd-455e-8a20-7aef5a6f636e', '799b902a-35e4-474d-864a-cf6cd0452d8b', '82634208-1bdc-4f92-a4ac-7663612f4430'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:17 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:12:17 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:18 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.info" returned: 0 in 1.087s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Acquiring lock "cinder-quobyte-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Lock "cinder-quobyte-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] snapshot: 921e8c2d-e2c5-46f0-bdd5-dbe58ead9692, volume: 9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7209f2a-c876-4daa-9c18-706f4bd38837]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:18 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.955s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:12:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Deleted volume successfully. Jun 25 18:12:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7cbb3943-468c-4d3d-9c5e-26b093c958cf tempest-VolumeRetypeWithoutMigrationTest-2086942043 None] Lock "cinder-6606e0c2-a6da-48c1-a588-993d4ab6f4fc-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:18 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 Jun 25 18:12:18 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:19 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692" returned: 0 in 1.076s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:12:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:12:19 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1abe92-1cfa-45c3-bbf3-124cb77332d4]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:19 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 Jun 25 18:12:19 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:20 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404" returned: 0 in 1.053s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:20 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:12:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:20 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 Jun 25 18:12:20 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:21 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:12:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Flow 'volume_create_manager' (fafd720f-22fe-4a8e-80f6-ba81a49ca2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1fe7b7-5c8e-4361-ad1d-67997ceb7000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1fe7b7-5c8e-4361-ad1d-67997ceb7000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1508719067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b30b1d0-7288-4756-9fff-7f1001b9fb75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ab74d92214502bf8a96c47a2d2c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:22Z,use_quota=True,user_id='410cbc4fbc7045cfbdb651bd9412afe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d4ffa5-8d95-416d-a8de-12970c0df085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d4ffa5-8d95-416d-a8de-12970c0df085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d469bcb-548a-4199-9946-9a892fdc93dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d469bcb-548a-4199-9946-9a892fdc93dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b30b1d0-7288-4756-9fff-7f1001b9fb75', 'volume_name': 'volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7548fe-dfcf-4a92-ab71-64dc9d74de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7548fe-dfcf-4a92-ab71-64dc9d74de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ab61a9-8db7-457a-aaab-6ca1c22ffe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:22 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Volume 8b30b1d0-7288-4756-9fff-7f1001b9fb75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75', 'volume_size': 1} Jun 25 18:12:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:27 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" returned: 0 in 7.423s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:27 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11f1524-4574-4671-b574-156c5c7b0810]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:27 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 Jun 25 18:12:27 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:29 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404" returned: 0 in 1.191s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:29 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:12:29 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Converted 1024.00 MB image at 137.91 MB/s Jun 25 18:12:29 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 is being set with open permissions: ugo+rw Jun 25 18:12:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:29 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 Jun 25 18:12:29 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:30 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" returned: 0 in 1.046s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Lock "cinder-quobyte-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" released by "_copy_volume_from_snapshot" :: held 11.963s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Acquiring lock "cinder-quobyte-921e8c2d-e2c5-46f0-bdd5-dbe58ead9692" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Lock "cinder-quobyte-921e8c2d-e2c5-46f0-bdd5-dbe58ead9692" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Deleting offline snapshot 921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 of volume 0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:12:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] snapshot_file for this snap is: volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:12:30 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5673a5-50df-4d90-80b3-482831e3b58b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:30 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 Jun 25 18:12:30 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:31 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692" returned: 0 in 0.963s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dfb117-e52b-4a64-85c7-bebc51b99c80]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:31 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 Jun 25 18:12:31 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:32 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=21,cinder:INSERT=7,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:12:32 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404" returned: 0 in 1.128s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:32 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 Jun 25 18:12:32 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:33 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692" returned: 0 in 1.282s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:33 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692 Jun 25 18:12:33 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:34 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404.921e8c2d-e2c5-46f0-bdd5-dbe58ead9692" returned: 0 in 0.858s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Lock "cinder-quobyte-921e8c2d-e2c5-46f0-bdd5-dbe58ead9692" released by "_delete_snapshot" :: held 4.428s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.502s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.450s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1508719067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b30b1d0-7288-4756-9fff-7f1001b9fb75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ab74d92214502bf8a96c47a2d2c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:22Z,use_quota=True,user_id='410cbc4fbc7045cfbdb651bd9412afe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Creating volume 8b30b1d0-7288-4756-9fff-7f1001b9fb75 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:12:34 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:34 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 1073741824 Jun 25 18:12:34 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321989bd-474c-4b66-9bf8-12f7ac527de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4', 'volume_size': 2, 'source_volid': '0d344b0b-dcc9-4d65-b974-0c9bca07a404', 'source_volstatus': 'available'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad96c32-b1fc-407c-92c3-00e504f98ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:34 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Volume volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 (9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4): created successfully Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad96c32-b1fc-407c-92c3-00e504f98ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Flow 'volume_create_manager' (bf82c7bd-e3de-4922-985b-ad2bdb7da6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:34 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5aa20c66-a17e-4de5-a07b-c1fcc2fd4f77 tempest-VolumesCloneTest-1905524736 None] Created volume successfully. Jun 25 18:12:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Acquiring lock "cinder-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Lock "cinder-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Acquiring lock "cinder-quobyte-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Lock "cinder-quobyte-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:35 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d31927-27d1-4440-abfb-39b99494b002]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:36 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 Jun 25 18:12:36 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:36 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 1073741824" returned: 0 in 1.537s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:36 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 Jun 25 18:12:36 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:37 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" returned: 0 in 1.161s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:37 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4 Jun 25 18:12:37 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:37 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75" returned: 0 in 1.109s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] <== create_volume: return (2714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:12:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.718s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ab61a9-8db7-457a-aaab-6ca1c22ffe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e019b1-c279-485a-96dc-f7bff9c0cda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:37 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Volume volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 (8b30b1d0-7288-4756-9fff-7f1001b9fb75): created successfully Jun 25 18:12:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e019b1-c279-485a-96dc-f7bff9c0cda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Flow 'volume_create_manager' (fafd720f-22fe-4a8e-80f6-ba81a49ca2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5bf86eb0-1aef-40f9-8628-7267538f23fd tempest-AttachVolumeNegativeTest-1899965128 None] Created volume successfully. Jun 25 18:12:38 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" returned: 0 in 1.009s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Lock "cinder-quobyte-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4" released by "delete_volume" :: held 2.249s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:38 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Created reservations ['7454933d-305f-4c62-8853-0b84f6fe823d', 'eb59de08-64f5-4ecb-878f-e2881b4d1649', '31009df5-7227-4112-821b-2260cf24e86b', '7e25f651-fb82-411d-b5a9-9bb26d451637'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:38 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:12:38 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:39 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.833s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:39 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:12:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Deleted volume successfully. Jun 25 18:12:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d18793a0-d3e2-4f9b-b0a8-ba31b02ab27b tempest-VolumesCloneTest-1905524736 None] Lock "cinder-9cbc9a6c-e6c3-4094-9bc4-ec042a8f43c4-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Acquiring lock "cinder-0d344b0b-dcc9-4d65-b974-0c9bca07a404-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Lock "cinder-0d344b0b-dcc9-4d65-b974-0c9bca07a404-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Acquiring lock "cinder-quobyte-0d344b0b-dcc9-4d65-b974-0c9bca07a404" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Lock "cinder-quobyte-0d344b0b-dcc9-4d65-b974-0c9bca07a404" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:39 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9651a77-1bd2-4a36-bfc8-b08ee6d0ac50]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:39 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 Jun 25 18:12:39 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:12:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:40 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:12:40 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:41 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404" returned: 0 in 1.441s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:41 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404 Jun 25 18:12:41 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-5bb1ee59-f816-46fe-a32a-f75575c04fc5 req-241982dc-86e9-4510-9f86-704b4511d541 tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-5bb1ee59-f816-46fe-a32a-f75575c04fc5 req-241982dc-86e9-4510-9f86-704b4511d541 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[179ae197-2171-4fb6-b027-ec6e8546fe83]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-5bb1ee59-f816-46fe-a32a-f75575c04fc5 req-241982dc-86e9-4510-9f86-704b4511d541 tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:41 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.433s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 8 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:12:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:12:41 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 Jun 25 18:12:41 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0d344b0b-dcc9-4d65-b974-0c9bca07a404" returned: 0 in 1.043s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:42 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Lock "cinder-quobyte-0d344b0b-dcc9-4d65-b974-0c9bca07a404" released by "delete_volume" :: held 2.593s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:42 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Created reservations ['604c3301-06c7-4200-b977-b0250938499f', '970baf2d-f993-4b8b-a868-90659f4e7787', 'e16b51b3-4ddc-4337-95f8-7d943b6f5cd4', '5216151e-f32d-4e55-a254-185e47918c12'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:42 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:12:42 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:43 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-5bb1ee59-f816-46fe-a32a-f75575c04fc5 req-241982dc-86e9-4510-9f86-704b4511d541 tempest-AttachVolumeNegativeTest-1899965128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75" returned: 0 in 1.417s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-5bb1ee59-f816-46fe-a32a-f75575c04fc5 req-241982dc-86e9-4510-9f86-704b4511d541 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.462s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-5bb1ee59-f816-46fe-a32a-f75575c04fc5 req-241982dc-86e9-4510-9f86-704b4511d541 tempest-AttachVolumeNegativeTest-1899965128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54b08ff4-afa8-46d8-81c4-779ee07ee280', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:12:43 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-5bb1ee59-f816-46fe-a32a-f75575c04fc5 req-241982dc-86e9-4510-9f86-704b4511d541 tempest-AttachVolumeNegativeTest-1899965128 None] attachment_update completed successfully. Jun 25 18:12:43 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.343s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:43 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:12:43 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Deleted volume successfully. Jun 25 18:12:43 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-981b7d77-d2e6-43fc-b614-9f5030e0b403 tempest-VolumesCloneTest-1905524736 None] Lock "cinder-0d344b0b-dcc9-4d65-b974-0c9bca07a404-delete_volume" released by "delete_volume" :: held 4.378s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (c2c81f53-e587-46f9-9ffe-4e6938bc6f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9459f1ec-cccf-4280-b469-0efdec920c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9459f1ec-cccf-4280-b469-0efdec920c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-424444817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89feaf62-8c15-44ab-865c-8edc1b5112e7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:49Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1fe88c-3908-471a-8348-fb3a4f4f8397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1fe88c-3908-471a-8348-fb3a4f4f8397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdd83b9-aacc-4f6c-abda-8ba6dcbf9be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdd83b9-aacc-4f6c-abda-8ba6dcbf9be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89feaf62-8c15-44ab-865c-8edc1b5112e7', 'volume_name': 'volume-89feaf62-8c15-44ab-865c-8edc1b5112e7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656e8b94-e5a3-429b-b25a-30a3d954d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656e8b94-e5a3-429b-b25a-30a3d954d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b103a6e0-e10d-4c9b-a765-17adc1a722bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Volume 89feaf62-8c15-44ab-865c-8edc1b5112e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89feaf62-8c15-44ab-865c-8edc1b5112e7', 'volume_size': 1} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-424444817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89feaf62-8c15-44ab-865c-8edc1b5112e7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:49Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Creating volume 89feaf62-8c15-44ab-865c-8edc1b5112e7 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:12:48 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:12:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:48 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 1073741824 Jun 25 18:12:48 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:50 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 1073741824" returned: 0 in 1.288s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:50 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 Jun 25 18:12:50 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:51 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7" returned: 0 in 1.010s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] <== create_volume: return (2376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:12:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.379s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b103a6e0-e10d-4c9b-a765-17adc1a722bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89feaf62-8c15-44ab-865c-8edc1b5112e7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471cf2ad-d497-4769-a709-edc609439106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:51 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Volume volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 (89feaf62-8c15-44ab-865c-8edc1b5112e7): created successfully Jun 25 18:12:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471cf2ad-d497-4769-a709-edc609439106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (c2c81f53-e587-46f9-9ffe-4e6938bc6f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f5de2526-d083-45cf-9d02-50c4b7a1e621 tempest-VolumesGetTest-1286722813 None] Created volume successfully. Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (8a256965-6bcb-44e5-a36a-7576ae399e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbd3aa3-3229-491c-b1a3-565e3b98f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbd3aa3-3229-491c-b1a3-565e3b98f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1285628996',display_name='tempest-VolumesGetTest-Volume-255326346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:53Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5f9939-a414-41f6-be4a-5f684a7085be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5f9939-a414-41f6-be4a-5f684a7085be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ece365-7796-4f98-837d-d326a48a25af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ece365-7796-4f98-837d-d326a48a25af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5', 'volume_name': 'volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b28215-306f-424a-ba56-c73685ed1dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b28215-306f-424a-ba56-c73685ed1dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c68ebc-d8b3-43c9-a989-6f4da3dd09b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:53 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Volume 7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5', 'volume_size': 1} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1285628996',display_name='tempest-VolumesGetTest-Volume-255326346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:53Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Creating volume 7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:12:53 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:12:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:53 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 1073741824 Jun 25 18:12:53 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:54 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 1073741824" returned: 0 in 1.224s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:54 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 Jun 25 18:12:54 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:55 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5" returned: 0 in 0.991s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:12:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.296s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c68ebc-d8b3-43c9-a989-6f4da3dd09b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1993703-de3c-4a71-bbe6-6639e7ea0641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:55 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Volume volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 (7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5): created successfully Jun 25 18:12:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1993703-de3c-4a71-bbe6-6639e7ea0641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (8a256965-6bcb-44e5-a36a-7576ae399e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:55 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e90887fc-9ca0-4a2e-8580-3235f31e255e tempest-VolumesGetTest-1286722813 None] Created volume successfully. Jun 25 18:12:56 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:56 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Lock "cinder-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:56 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-quobyte-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:56 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:56 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfed7066-efca-4ee0-988c-ebfc5b5a1433]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:56 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 Jun 25 18:12:56 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:57 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5" returned: 0 in 1.153s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:58 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5 Jun 25 18:12:58 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:59 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5" returned: 0 in 1.017s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5" released by "delete_volume" :: held 2.248s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:59 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Created reservations ['bd882e6e-8546-40ef-9d8b-4099e9d0f54c', '92196dfe-3b0a-49cc-9e85-057a40a34ec3', '70050d94-9124-4b56-8933-db9b69b968bb', '5ffafe74-90f3-4042-b327-0d7513736b98'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:59 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:59 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:59 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:12:59 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:00 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.864s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:00 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:00 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Deleted volume successfully. Jun 25 18:13:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-89feaf62-8c15-44ab-865c-8edc1b5112e7-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc682c1-2b53-4620-8ffb-844320b900df tempest-VolumesGetTest-1286722813 None] Lock "cinder-7d0e3309-ba9a-4749-9dbe-fbb2a39aa0b5-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Lock "cinder-89feaf62-8c15-44ab-865c-8edc1b5112e7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-quobyte-89feaf62-8c15-44ab-865c-8edc1b5112e7" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-89feaf62-8c15-44ab-865c-8edc1b5112e7" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:00 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9fed5c-eead-46d8-93cb-5d509ae35cd2]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:00 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 Jun 25 18:13:00 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:01 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7" returned: 0 in 1.299s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:01 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7 Jun 25 18:13:01 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:02 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89feaf62-8c15-44ab-865c-8edc1b5112e7" returned: 0 in 0.877s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-89feaf62-8c15-44ab-865c-8edc1b5112e7" released by "delete_volume" :: held 2.233s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:02 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Created reservations ['dc04f46f-dedc-48a1-8fc2-a7d79688746e', '084ab5d4-ef9d-4a4e-b107-9dcc3f8209bf', '944c1861-8ea3-43d4-8b66-dc7cfc1a44a2', '65d6e0d0-2a29-46e6-b7df-3e5d0dc83a47'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:02 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:13:02 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:04 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.654s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Deleted volume successfully. Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-393d381a-534f-4d7c-b2c7-cb8d2789eb69 tempest-VolumesGetTest-1286722813 None] Lock "cinder-89feaf62-8c15-44ab-865c-8edc1b5112e7-delete_volume" released by "delete_volume" :: held 4.264s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (5edc23e0-7ab1-47c4-bbe1-1b60ae4eb2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71f56b4-137d-464a-b368-ebe4481c0ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71f56b4-137d-464a-b368-ebe4481c0ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1877901772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7b180e-62b7-4ab8-b4fc-a9db653bae85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:05Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfb804a-3696-49f5-9034-5a0280e2c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfb804a-3696-49f5-9034-5a0280e2c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b87287c-9be9-430b-a5be-587639479584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b87287c-9be9-430b-a5be-587639479584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa7b180e-62b7-4ab8-b4fc-a9db653bae85', 'volume_name': 'volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85689687-c77c-460e-a774-629b13e41f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85689687-c77c-460e-a774-629b13e41f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a3ce71-e2d1-4d02-9677-16db625c8c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:04 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Volume fa7b180e-62b7-4ab8-b4fc-a9db653bae85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85', 'volume_size': 1} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1877901772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7b180e-62b7-4ab8-b4fc-a9db653bae85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:05Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Creating volume fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:04 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:13:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:04 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 1073741824 Jun 25 18:13:04 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:06 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 1073741824" returned: 0 in 1.937s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:06 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 Jun 25 18:13:06 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:08 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" returned: 0 in 1.675s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] <== create_volume: return (3713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:13:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.716s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a3ce71-e2d1-4d02-9677-16db625c8c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaa6f9f-bbf0-4ac4-8ad2-b419cc4fd46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:08 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=61,cinder:UPDATE=68,cinder:DELETE=4,cinder:INSERT=17 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:13:08 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Volume volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 (fa7b180e-62b7-4ab8-b4fc-a9db653bae85): created successfully Jun 25 18:13:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaa6f9f-bbf0-4ac4-8ad2-b419cc4fd46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (5edc23e0-7ab1-47c4-bbe1-1b60ae4eb2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:08 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-afd0f788-cf4f-4b5a-8d58-f9342c85d600 tempest-VolumesGetTest-1286722813 None] Created volume successfully. Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (d073faba-4405-40b5-81fa-d07c0b05d382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695f3f72-7072-4f38-8159-f3739a5aa242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695f3f72-7072-4f38-8159-f3739a5aa242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1826222945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba1e759-485e-4a5f-9ea4-67f81f2e60d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fa7b180e-62b7-4ab8-b4fc-a9db653bae85,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:10Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f1569d-6c43-43c8-86d4-f8ada52b8760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f1569d-6c43-43c8-86d4-f8ada52b8760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c24b05-ea0b-4634-9255-e02b3eaab77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c24b05-ea0b-4634-9255-e02b3eaab77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fba1e759-485e-4a5f-9ea4-67f81f2e60d0', 'volume_name': 'volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0', 'volume_size': 1, 'source_volid': 'fa7b180e-62b7-4ab8-b4fc-a9db653bae85', 'source_volstatus': 'available'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3b79e9-d904-4f86-ac29-370c17d30c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3b79e9-d904-4f86-ac29-370c17d30c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431be5cf-9b5c-494e-9a4b-7c3987dea21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:10 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Volume fba1e759-485e-4a5f-9ea4-67f81f2e60d0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0', 'volume_size': 1, 'source_volid': 'fa7b180e-62b7-4ab8-b4fc-a9db653bae85', 'source_volstatus': 'available'} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:10 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Cloning volume fa7b180e-62b7-4ab8-b4fc-a9db653bae85 to volume fba1e759-485e-4a5f-9ea4-67f81f2e60d0 Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Creating offline snapshot 99281a73-f9ea-44ee-b5d1-7f983da86b8a of volume fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b51abd-82a9-4444-9f1c-566dd7c59e30]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:10 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 Jun 25 18:13:10 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:11 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" returned: 0 in 1.294s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:11 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a 1G Jun 25 18:13:11 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:13 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a 1G" returned: 0 in 2.190s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:14 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a Jun 25 18:13:14 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:15 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a" returned: 0 in 1.714s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:15 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a is being set with open permissions: ugo+rw Jun 25 18:13:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:15 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a Jun 25 18:13:15 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:17 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a" returned: 0 in 2.168s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:17 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.info Jun 25 18:13:17 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:19 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.info" returned: 0 in 1.908s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:19 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.info is being set with open permissions: ugo+rw Jun 25 18:13:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:19 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.info Jun 25 18:13:19 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:21 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.info" returned: 0 in 1.703s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-quobyte-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] snapshot: 99281a73-f9ea-44ee-b5d1-7f983da86b8a, volume: fba1e759-485e-4a5f-9ea4-67f81f2e60d0, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e5dcfb-6bfb-455e-8795-82ba687d7344]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:22 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a Jun 25 18:13:22 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:23 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a" returned: 0 in 2.000s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:13:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:13:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:13:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6a25e-f735-4f51-aa9a-54169917789a]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:24 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 Jun 25 18:13:24 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:25 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" returned: 0 in 1.556s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:25 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:13:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:25 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 Jun 25 18:13:25 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:27 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=1,cinder:INSERT=1,cinder:SELECT=3 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:13:27 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=51,cinder:SELECT=36,cinder:INSERT=10,cinder:DELETE=7 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:13:38 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" returned: 0 in 12.563s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb861a1-6f20-4dc8-ac90-fe2ba0c09607]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (fc135f48-85f1-4f43-8370-a5a5add5e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efa3eb2-cf8f-4bf1-936b-a4cc918fd0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efa3eb2-cf8f-4bf1-936b-a4cc918fd0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-193855139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:38Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003e2293-17f8-4a7b-ace9-9ffd7164d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003e2293-17f8-4a7b-ace9-9ffd7164d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e415977b-1200-4bc5-b6da-62615c75a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e415977b-1200-4bc5-b6da-62615c75a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b', 'volume_name': 'volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bca4da4-216f-41c1-9a42-5ef50eaf7d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bca4da4-216f-41c1-9a42-5ef50eaf7d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a808933b-db60-412d-9f8d-962c534a2e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:38 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Volume a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b', 'volume_size': 1} Jun 25 18:13:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:38 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 Jun 25 18:13:38 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:39 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" returned: 0 in 1.734s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:39 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85, size 1024.00 MB, duration 12.57 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:13:39 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Converted 1024.00 MB image at 81.49 MB/s Jun 25 18:13:39 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 is being set with open permissions: ugo+rw Jun 25 18:13:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:39 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 Jun 25 18:13:39 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Flow 'volume_create_manager' (5d6b3168-dbcc-4ed0-ad1e-495825984b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773f2e31-7fb2-45ed-8023-0b0586628fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773f2e31-7fb2-45ed-8023-0b0586628fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1491268578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1255779-2e32-4ede-ae34-9fedd104b355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c179c72bda4b8ebb7f52730b34b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:40Z,use_quota=True,user_id='a7917abf22044d22af38a06d8e56bb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190d0e1b-3fa2-4072-8a17-d84f4900d930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190d0e1b-3fa2-4072-8a17-d84f4900d930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116aa174-3cea-4dc3-8b96-7a1ff3f6ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116aa174-3cea-4dc3-8b96-7a1ff3f6ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1255779-2e32-4ede-ae34-9fedd104b355', 'volume_name': 'volume-b1255779-2e32-4ede-ae34-9fedd104b355', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985ed77a-d99c-423c-bccf-ae51a290d7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985ed77a-d99c-423c-bccf-ae51a290d7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0b475d-98c7-44d8-9837-41a34d9ab1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:40 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Volume b1255779-2e32-4ede-ae34-9fedd104b355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1255779-2e32-4ede-ae34-9fedd104b355', 'volume_size': 1} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:40 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:13:40 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:40 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" returned: 0 in 1.086s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" released by "_copy_volume_from_snapshot" :: held 19.209s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-quobyte-99281a73-f9ea-44ee-b5d1-7f983da86b8a" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-99281a73-f9ea-44ee-b5d1-7f983da86b8a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Deleting offline snapshot 99281a73-f9ea-44ee-b5d1-7f983da86b8a of volume fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] snapshot_file for this snap is: volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[804a6790-7a16-40be-9e2c-bce53ef6cfc7]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:41 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a Jun 25 18:13:41 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:41 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.015s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:13:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 8 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:13:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:13:42 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a" returned: 0 in 1.185s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:13:42 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b91321-ee80-47cd-8a0c-48b768b910d8]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:42 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 Jun 25 18:13:42 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:43 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" returned: 0 in 1.182s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:43 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a Jun 25 18:13:43 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:44 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a" returned: 0 in 1.010s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:44 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a Jun 25 18:13:44 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:45 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85.99281a73-f9ea-44ee-b5d1-7f983da86b8a" returned: 0 in 1.150s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-99281a73-f9ea-44ee-b5d1-7f983da86b8a" released by "_delete_snapshot" :: held 4.683s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 35.388s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.481s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-193855139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:38Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Creating volume a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:45 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:45 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b 1073741824 Jun 25 18:13:45 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431be5cf-9b5c-494e-9a4b-7c3987dea21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0', 'volume_size': 1, 'source_volid': 'fa7b180e-62b7-4ab8-b4fc-a9db653bae85', 'source_volstatus': 'available'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e5c387-ed51-411c-b056-5d8ae7d6a15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:45 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Volume volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 (fba1e759-485e-4a5f-9ea4-67f81f2e60d0): created successfully Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e5c387-ed51-411c-b056-5d8ae7d6a15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (d073faba-4405-40b5-81fa-d07c0b05d382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c06e010e-559a-4642-8876-57795b6f2c4d tempest-VolumesGetTest-1286722813 None] Created volume successfully. Jun 25 18:13:46 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b 1073741824" returned: 0 in 1.196s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:47 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b Jun 25 18:13:47 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (cf7ce224-c6d8-4e14-9651-b6eced4a30b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c031a1-46d8-4620-ad7b-2a92c4a1530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:48 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b" returned: 0 in 1.481s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] <== create_volume: return (2764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.769s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.119s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1491268578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1255779-2e32-4ede-ae34-9fedd104b355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c179c72bda4b8ebb7f52730b34b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:40Z,use_quota=True,user_id='a7917abf22044d22af38a06d8e56bb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Creating volume b1255779-2e32-4ede-ae34-9fedd104b355 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:48 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c031a1-46d8-4620-ad7b-2a92c4a1530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2040417004',display_name='tempest-VolumesGetTest-Volume-693745078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1870700-19c1-4558-a908-cd75569b4534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:48Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9d379a-d871-4933-88c5-e611b606ec05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9d379a-d871-4933-88c5-e611b606ec05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaf7fe8-d272-4c2d-9bb7-546167059604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaf7fe8-d272-4c2d-9bb7-546167059604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1870700-19c1-4558-a908-cd75569b4534', 'volume_name': 'volume-c1870700-19c1-4558-a908-cd75569b4534', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:48 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355 1073741824 Jun 25 18:13:48 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb4dc8e-f1e0-4051-b21d-f4ccead06a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb4dc8e-f1e0-4051-b21d-f4ccead06a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6791113d-a189-4b27-8736-f001a9853190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Volume c1870700-19c1-4558-a908-cd75569b4534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1870700-19c1-4558-a908-cd75569b4534', 'volume_size': 1} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a808933b-db60-412d-9f8d-962c534a2e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b1a9ba-7752-450b-9349-1e8922904fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Volume volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b (a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b): created successfully Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b1a9ba-7752-450b-9349-1e8922904fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (fc135f48-85f1-4f43-8370-a5a5add5e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:48 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-15941849-57f7-47d4-bf76-6c661bb8a55b tempest-VolumesActionsTest-1016561402 None] Created volume successfully. Jun 25 18:13:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0408d9be-8229-4e4d-ae3c-5705b7867a2a tempest-VolumesActionsTest-1016561402 None] Acquiring lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b" by "attach_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0408d9be-8229-4e4d-ae3c-5705b7867a2a tempest-VolumesActionsTest-1016561402 None] Lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b" acquired by "attach_volume" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:49 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355 1073741824" returned: 0 in 1.460s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:50 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355 Jun 25 18:13:50 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:50 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0408d9be-8229-4e4d-ae3c-5705b7867a2a tempest-VolumesActionsTest-1016561402 None] Attaching volume a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b to instance c5fe9359-0f8d-47f7-8456-0f9e1a62aebf at mountpoint /dev/vdb on host None. Jun 25 18:13:50 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0408d9be-8229-4e4d-ae3c-5705b7867a2a tempest-VolumesActionsTest-1016561402 None] Attach volume completed successfully. Jun 25 18:13:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0408d9be-8229-4e4d-ae3c-5705b7867a2a tempest-VolumesActionsTest-1016561402 None] Lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b" released by "attach_volume" :: held 0.309s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f995b645-0f44-461f-bb3b-33e55a95144c tempest-VolumesActionsTest-921851170 None] Terminate volume connection completed successfully. Jun 25 18:13:51 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355" returned: 0 in 0.999s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] <== create_volume: return (2563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.567s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.444s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2040417004',display_name='tempest-VolumesGetTest-Volume-693745078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1870700-19c1-4558-a908-cd75569b4534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:48Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Creating volume c1870700-19c1-4558-a908-cd75569b4534 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:51 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:51 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534 1073741824 Jun 25 18:13:51 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0b475d-98c7-44d8-9837-41a34d9ab1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1255779-2e32-4ede-ae34-9fedd104b355', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc24123-9fab-4db1-b1ca-3a30a3ad81d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:51 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Volume volume-b1255779-2e32-4ede-ae34-9fedd104b355 (b1255779-2e32-4ede-ae34-9fedd104b355): created successfully Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc24123-9fab-4db1-b1ca-3a30a3ad81d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Flow 'volume_create_manager' (5d6b3168-dbcc-4ed0-ad1e-495825984b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6f431cc5-f425-48bc-9413-40593e00056e tempest-ServerRescueNegativeTestJSON-475709989 None] Created volume successfully. Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f995b645-0f44-461f-bb3b-33e55a95144c tempest-VolumesActionsTest-921851170 None] Acquiring lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b-detach_volume" by "detach_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f995b645-0f44-461f-bb3b-33e55a95144c tempest-VolumesActionsTest-921851170 None] Lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f995b645-0f44-461f-bb3b-33e55a95144c tempest-VolumesActionsTest-921851170 None] Detaching volume a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b from instance c5fe9359-0f8d-47f7-8456-0f9e1a62aebf. Jun 25 18:13:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f995b645-0f44-461f-bb3b-33e55a95144c tempest-VolumesActionsTest-921851170 None] Detach volume completed successfully. Jun 25 18:13:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f995b645-0f44-461f-bb3b-33e55a95144c tempest-VolumesActionsTest-921851170 None] Lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2907bd01-5e17-4c4c-b085-eb95bc559de4 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b-detach_volume" by "detach_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2907bd01-5e17-4c4c-b085-eb95bc559de4 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b-detach_volume" acquired by "detach_volume" :: waited 0.075s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:52 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2907bd01-5e17-4c4c-b085-eb95bc559de4 tempest-VolumesActionsTest-1016561402 None] Volume detach called, but volume not attached. Jun 25 18:13:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2907bd01-5e17-4c4c-b085-eb95bc559de4 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:52 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534 1073741824" returned: 0 in 1.874s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:53 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534 Jun 25 18:13:53 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "cinder-quobyte-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-quobyte-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b" acquired by "delete_volume" :: waited 0.050s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9845f13-1233-4846-85be-0a575ff10204]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:54 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b Jun 25 18:13:54 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:54 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534" returned: 0 in 1.211s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] <== create_volume: return (3144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.148s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6791113d-a189-4b27-8736-f001a9853190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1870700-19c1-4558-a908-cd75569b4534', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02d5bd3-acb7-48a0-99f8-7641e6f587c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:54 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Volume volume-c1870700-19c1-4558-a908-cd75569b4534 (c1870700-19c1-4558-a908-cd75569b4534): created successfully Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02d5bd3-acb7-48a0-99f8-7641e6f587c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (cf7ce224-c6d8-4e14-9651-b6eced4a30b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:54 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a5ea1e4a-341e-4bda-a629-bde8d5bd4976 tempest-VolumesGetTest-1286722813 None] Created volume successfully. Jun 25 18:13:54 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b" returned: 0 in 0.942s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:55 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b Jun 25 18:13:55 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-c1870700-19c1-4558-a908-cd75569b4534-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Lock "cinder-c1870700-19c1-4558-a908-cd75569b4534-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-quobyte-c1870700-19c1-4558-a908-cd75569b4534" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-c1870700-19c1-4558-a908-cd75569b4534" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:55 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[db82a54e-6293-4add-be78-ce53d4585d8a]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:55 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534 Jun 25 18:13:55 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:56 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b" returned: 0 in 1.170s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-quobyte-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b" released by "delete_volume" :: held 2.191s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Created reservations ['ace4f782-688b-4c49-879b-27675eb0ed00', '4824171b-f28f-43ce-86e6-7a4d064a4643', '1e2a14b0-2518-4426-876c-bf6d61e2106f', 'b2db6fb3-5569-4bf1-8650-53f762d29956'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:56 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:13:56 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:56 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534" returned: 0 in 1.249s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:56 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534 Jun 25 18:13:56 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:57 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.875s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:57 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Deleted volume successfully. Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9c88bca0-f2c6-4483-ab45-f07a357a2480 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-a2a9caa1-e5a8-4e9c-8c40-09dd31151f4b-delete_volume" released by "delete_volume" :: held 3.502s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:57 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c1870700-19c1-4558-a908-cd75569b4534" returned: 0 in 0.871s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-c1870700-19c1-4558-a908-cd75569b4534" released by "delete_volume" :: held 2.245s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Created reservations ['70084723-f398-4b13-8be3-d11c314a03ee', '2d0d65dd-750c-485e-a56a-419bdf65d8f8', '60d93e94-3463-4895-bf25-0ad6d324364e', '22cae9d2-1688-4e75-a7d8-c84ec8125f81'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:57 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:13:57 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:58 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.014s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:58 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:58 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Deleted volume successfully. Jun 25 18:13:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c01be07e-3a00-4471-9144-a62165f7d0e3 tempest-VolumesGetTest-1286722813 None] Lock "cinder-c1870700-19c1-4558-a908-cd75569b4534-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-fba1e759-485e-4a5f-9ea4-67f81f2e60d0-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Lock "cinder-fba1e759-485e-4a5f-9ea4-67f81f2e60d0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-quobyte-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" acquired by "delete_volume" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:59 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[288be96c-c343-4d61-ba4c-ff3959541c85]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:59 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 Jun 25 18:13:59 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:00 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" returned: 0 in 1.108s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:00 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0 Jun 25 18:14:00 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:00 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-da00aa6d-dbb5-43df-9e5f-b249609177f9 req-83560706-a1ed-455a-9b06-6034b579e2a5 tempest-AttachVolumeNegativeTest-1899965128 None] Terminate volume connection completed successfully. Jun 25 18:14:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-da00aa6d-dbb5-43df-9e5f-b249609177f9 req-83560706-a1ed-455a-9b06-6034b579e2a5 tempest-AttachVolumeNegativeTest-1899965128 None] Deleting attachment 54b08ff4-afa8-46d8-81c4-779ee07ee280. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:14:01 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" returned: 0 in 0.855s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:01 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-fba1e759-485e-4a5f-9ea4-67f81f2e60d0" released by "delete_volume" :: held 2.022s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:01 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Created reservations ['4322541b-4087-41d4-9bde-408a4e81fe07', '2f538599-de96-43ea-8100-bfde8c7d0b06', 'cdbd7422-1011-4719-b415-20360248d47c', '3b82aa0f-a92f-47c6-90ad-d5d24df7a8b2'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:01 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:01 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:02 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.293s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:02 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Deleted volume successfully. Jun 25 18:14:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-871bd41b-2f20-448e-b1c0-55d8c7178de3 tempest-VolumesGetTest-1286722813 None] Lock "cinder-fba1e759-485e-4a5f-9ea4-67f81f2e60d0-delete_volume" released by "delete_volume" :: held 3.704s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-fa7b180e-62b7-4ab8-b4fc-a9db653bae85-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Lock "cinder-fa7b180e-62b7-4ab8-b4fc-a9db653bae85-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-quobyte-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:03 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee829026-13ec-445b-8fb0-48b998e3af81]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:03 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 Jun 25 18:14:03 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:04 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" returned: 0 in 1.194s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:04 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85 Jun 25 18:14:04 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:05 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" returned: 0 in 1.471s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-fa7b180e-62b7-4ab8-b4fc-a9db653bae85" released by "delete_volume" :: held 2.847s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:06 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Created reservations ['914f0f67-091d-4c48-ab54-88c0590fd60d', 'b266390a-99da-4385-9f05-a7b925b02534', 'e20d65b5-9dd6-4093-8940-48b27f477c64', '9a2acaf7-0b3a-4957-b991-0b936c0db2f6'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:06 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:06 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:07 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (6fabb1f2-d4c5-41e4-bfc2-825c52f24115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6841c9a-25c1-4216-b2fd-42ad6517c887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:07 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6841c9a-25c1-4216-b2fd-42ad6517c887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1640083509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413235a5-fed0-46ba-9378-bcde64e1dafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:08Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d917731-2207-4cb3-aec3-d8af603f6668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d917731-2207-4cb3-aec3-d8af603f6668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec3b922-be70-4ea8-ba4c-6751b6f900ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec3b922-be70-4ea8-ba4c-6751b6f900ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413235a5-fed0-46ba-9378-bcde64e1dafc', 'volume_name': 'volume-413235a5-fed0-46ba-9378-bcde64e1dafc', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ba7246-9271-4f6d-8583-2a88e7074499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ba7246-9271-4f6d-8583-2a88e7074499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621bada0-ba52-4711-9eeb-f2f7a570f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:08 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Volume 413235a5-fed0-46ba-9378-bcde64e1dafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413235a5-fed0-46ba-9378-bcde64e1dafc', 'volume_size': 1} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1640083509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413235a5-fed0-46ba-9378-bcde64e1dafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:08Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Creating volume 413235a5-fed0-46ba-9378-bcde64e1dafc {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:08 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.867s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:08 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Deleted volume successfully. Jun 25 18:14:08 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc 1073741824 Jun 25 18:14:08 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-caf7e9bc-41c4-4797-ab10-bbd8a6dbb98c tempest-VolumesGetTest-1286722813 None] Lock "cinder-fa7b180e-62b7-4ab8-b4fc-a9db653bae85-delete_volume" released by "delete_volume" :: held 5.373s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:09 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (38a9bcb3-f372-40c9-b36b-2944569a4e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3712593-5a00-4241-9219-a064c201097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3712593-5a00-4241-9219-a064c201097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1046884173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ec9e78-1993-42e6-b8c1-84333c7c19a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:09Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f30de9f-e9e2-4b3b-85b0-39a2dafec0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f30de9f-e9e2-4b3b-85b0-39a2dafec0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5610a877-bd8d-4ea6-91b9-2cac4ae2cb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:09 devstack cinder-volume[93767]: DEBUG cinder.image.glance [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Creating Keystone auth plugin from conf {{(pid=93767) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:14:10 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc 1073741824" returned: 0 in 2.314s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:10 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc Jun 25 18:14:10 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5610a877-bd8d-4ea6-91b9-2cac4ae2cb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40ec9e78-1993-42e6-b8c1-84333c7c19a9', 'volume_name': 'volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d8f5e8-c014-472f-8772-e246462d874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d8f5e8-c014-472f-8772-e246462d874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a4d8d6-cfc2-4a5c-ae12-964b5f7d469e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:10 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Volume 40ec9e78-1993-42e6-b8c1-84333c7c19a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 18:14:10 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Trying to clone 40ec9e78-1993-42e6-b8c1-84333c7c19a9 from image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]). {{(pid=93767) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:14:11 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Image download 20.69 MB at 20.69 MB/s Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff0efc8-92ac-43ed-b58f-f82de682b1e1]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:11 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc" returned: 0 in 0.998s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] <== create_volume: return (3419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.427s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621bada0-ba52-4711-9eeb-f2f7a570f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413235a5-fed0-46ba-9378-bcde64e1dafc', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a5b6e8-ab8f-4413-93e6-0dfaba0f84dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:11 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Volume volume-413235a5-fed0-46ba-9378-bcde64e1dafc (413235a5-fed0-46ba-9378-bcde64e1dafc): created successfully Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a5b6e8-ab8f-4413-93e6-0dfaba0f84dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:11 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD Jun 25 18:14:11 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (6fabb1f2-d4c5-41e4-bfc2-825c52f24115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:11 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f63fe989-08a5-4a89-9c84-3b87c459e8c9 tempest-VolumesActionsTest-1016561402 None] Created volume successfully. Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Acquiring lock "cinder-413235a5-fed0-46ba-9378-bcde64e1dafc-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Lock "cinder-413235a5-fed0-46ba-9378-bcde64e1dafc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Acquiring lock "cinder-quobyte-413235a5-fed0-46ba-9378-bcde64e1dafc" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Lock "cinder-quobyte-413235a5-fed0-46ba-9378-bcde64e1dafc" acquired by "delete_volume" :: waited 0.044s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bcf579-9e3f-48bb-bfef-9688d7cd78a9]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:12 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD" returned: 0 in 1.286s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Temporary image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f is fetched for user 4357ca1ce5544ed09046a0cce057893a. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:14:12 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc Jun 25 18:14:12 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd091b5-2e6a-4741-ab6c-7068a98e4759]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:12 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD Jun 25 18:14:12 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:14 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc" returned: 0 in 1.510s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:14 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc Jun 25 18:14:14 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:14 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD" returned: 0 in 1.426s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1046884173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ec9e78-1993-42e6-b8c1-84333c7c19a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:09Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Creating volume 40ec9e78-1993-42e6-b8c1-84333c7c19a9 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:14 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:14:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:14 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 1073741824 Jun 25 18:14:14 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:15 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-413235a5-fed0-46ba-9378-bcde64e1dafc" returned: 0 in 1.229s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Lock "cinder-quobyte-413235a5-fed0-46ba-9378-bcde64e1dafc" released by "delete_volume" :: held 2.836s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Created reservations ['7541fb70-52fc-4a14-be7b-aae2e3f78f3d', 'fffc3665-f9e1-4f99-8600-d7babd2bacc2', 'aa7d0edd-ddcf-457f-976a-5297b8e98441', '7fba55fd-d54b-411b-980a-0a82ef63135f'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:15 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:15 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:15 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 1073741824" returned: 0 in 1.499s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:15 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 Jun 25 18:14:15 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Acquiring lock "cinder-b1255779-2e32-4ede-ae34-9fedd104b355-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "cinder-b1255779-2e32-4ede-ae34-9fedd104b355-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:17 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:17 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (dddccb19-c27d-4385-be5a-5e533bf6d918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10108fa0-709b-4fd8-a045-7c3a4c3a60a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9" returned: 0 in 1.605s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] <== create_volume: return (3200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.205s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.879s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10108fa0-709b-4fd8-a045-7c3a4c3a60a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1531287193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c7da64-8397-49f9-86f4-2766283acdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:17Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b2494b-8850-4c2c-9ba8-d8b11dc386bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b2494b-8850-4c2c-9ba8-d8b11dc386bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283c93d0-3888-4745-b526-a9f57eddbca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283c93d0-3888-4745-b526-a9f57eddbca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c7da64-8397-49f9-86f4-2766283acdb3', 'volume_name': 'volume-54c7da64-8397-49f9-86f4-2766283acdb3', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6fab0c-0b2e-4967-af67-13c04b49c894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6fab0c-0b2e-4967-af67-13c04b49c894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c28941f-fd4b-4d85-bbe1-4e5a6ac08cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:17 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Volume 54c7da64-8397-49f9-86f4-2766283acdb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c7da64-8397-49f9-86f4-2766283acdb3', 'volume_size': 1} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1531287193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c7da64-8397-49f9-86f4-2766283acdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:17Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Creating volume 54c7da64-8397-49f9-86f4-2766283acdb3 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:17 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Deleted volume successfully. Jun 25 18:14:17 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3 1073741824 Jun 25 18:14:17 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Attempting download of cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}])) to volume 40ec9e78-1993-42e6-b8c1-84333c7c19a9. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6c613d1a-7b95-4c65-9e93-fece51ddc2ab tempest-VolumesActionsTest-921851170 None] Lock "cinder-413235a5-fed0-46ba-9378-bcde64e1dafc-delete_volume" released by "delete_volume" :: held 5.302s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Acquiring lock "cinder-quobyte-b1255779-2e32-4ede-ae34-9fedd104b355" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "cinder-quobyte-b1255779-2e32-4ede-ae34-9fedd104b355" acquired by "delete_volume" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccc9e96-b468-4b53-9aa1-45f0d07c8a12]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9b70f9-7a08-4527-8014-2ededd1a1394]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_wo6fdz1_ {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:17 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_wo6fdz1_ Jun 25 18:14:17 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:17 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355 Jun 25 18:14:17 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:18 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_wo6fdz1_" returned: 0 in 1.183s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_wo6fdz1_ {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:19 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_wo6fdz1_ Jun 25 18:14:19 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:19 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355" returned: 0 in 1.789s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:19 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355 Jun 25 18:14:19 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:19 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3 1073741824" returned: 0 in 2.127s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:19 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3 Jun 25 18:14:19 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:19 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_wo6fdz1_" returned: 1 in 1.015s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_wo6fdz1_' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:14:19 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e010f6-aeac-4bb0-9710-651a9be72bdb]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:20 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD Jun 25 18:14:20 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:20 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b1255779-2e32-4ede-ae34-9fedd104b355" returned: 0 in 1.263s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "cinder-quobyte-b1255779-2e32-4ede-ae34-9fedd104b355" released by "delete_volume" :: held 3.152s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:20 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Created reservations ['5f3b2f2c-b485-4534-9bfc-771b7142a85d', '0e4f8315-2a22-4fb0-b408-f44345e47f81', '910caa0f-a208-4596-ab94-04353e086fb4', '0d510a12-d8ac-4317-a54a-7dc950ed802e'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:21 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:21 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:21 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3" returned: 0 in 1.466s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] <== create_volume: return (3668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.670s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c28941f-fd4b-4d85-bbe1-4e5a6ac08cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c7da64-8397-49f9-86f4-2766283acdb3', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af325a27-70bc-46e0-a5c3-69bff625052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:21 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD" returned: 0 in 1.251s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f was qcow2, converting to raw {{(pid=93767) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:21 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Volume volume-54c7da64-8397-49f9-86f4-2766283acdb3 (54c7da64-8397-49f9-86f4-2766283acdb3): created successfully Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af325a27-70bc-46e0-a5c3-69bff625052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:21 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 Jun 25 18:14:21 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (dddccb19-c27d-4385-be5a-5e533bf6d918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:21 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-de214550-5835-43b0-b596-183fb9f85c12 tempest-VolumesActionsTest-1016561402 None] Created volume successfully. Jun 25 18:14:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Acquiring lock "cinder-54c7da64-8397-49f9-86f4-2766283acdb3-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Lock "cinder-54c7da64-8397-49f9-86f4-2766283acdb3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Acquiring lock "cinder-quobyte-54c7da64-8397-49f9-86f4-2766283acdb3" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Lock "cinder-quobyte-54c7da64-8397-49f9-86f4-2766283acdb3" acquired by "delete_volume" :: waited 0.043s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad1c4c-376b-48a4-9407-e08345e65c27]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:22 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.514s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:22 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Deleted volume successfully. Jun 25 18:14:22 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3 Jun 25 18:14:22 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6ddea3c0-91d5-4ce6-9377-a177cc46a59f tempest-ServerRescueNegativeTestJSON-475709989 None] Lock "cinder-b1255779-2e32-4ede-ae34-9fedd104b355-delete_volume" released by "delete_volume" :: held 5.379s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:24 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3" returned: 0 in 1.612s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:24 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3 Jun 25 18:14:24 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:25 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-54c7da64-8397-49f9-86f4-2766283acdb3" returned: 0 in 1.403s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Lock "cinder-quobyte-54c7da64-8397-49f9-86f4-2766283acdb3" released by "delete_volume" :: held 3.126s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Created reservations ['84282282-48d5-457d-b2c5-5f6288e92cce', '80fb003b-3350-4644-a7b2-777670900355', 'caa8855e-25b7-4082-aa4d-a6830e7a15af', '31b9aea7-e412-4792-a71d-0e6f63d4d549'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:25 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9" returned: 0 in 4.385s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_o0646hcrdevstack@QuobyteHD, size 112.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:14:25 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Converted 112.00 MB image at 25.54 MB/s Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:25 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 1G Jun 25 18:14:25 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:25 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:25 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:27 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.350s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:27 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Deleted volume successfully. Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8299f46c-60bf-4063-9777-7b1bfa80ca54 tempest-VolumesActionsTest-921851170 None] Lock "cinder-54c7da64-8397-49f9-86f4-2766283acdb3-delete_volume" released by "delete_volume" :: held 4.927s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 1G" returned: 0 in 1.495s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:27 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4d15d4-6cb1-4d45-b21a-0c92a34c0c1c]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:27 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 Jun 25 18:14:27 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (e66e7628-20b6-4e2d-a395-cdaedc260ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9802ecc-7b39-402c-90f2-b00139599aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9802ecc-7b39-402c-90f2-b00139599aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424313159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82512de-4d9a-4e74-8c8e-043e8c61ac99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:27Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188987b0-eb21-43b6-85ed-07898e106294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188987b0-eb21-43b6-85ed-07898e106294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9a5a64-eb2b-46ef-ae70-3a624c849158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9a5a64-eb2b-46ef-ae70-3a624c849158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82512de-4d9a-4e74-8c8e-043e8c61ac99', 'volume_name': 'volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b44147-0320-45c0-b87c-6858e63f04b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b44147-0320-45c0-b87c-6858e63f04b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e68327-16a7-4781-ad85-d864a3deaf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:27 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Volume b82512de-4d9a-4e74-8c8e-043e8c61ac99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99', 'volume_size': 1} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424313159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82512de-4d9a-4e74-8c8e-043e8c61ac99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:27Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Creating volume b82512de-4d9a-4e74-8c8e-043e8c61ac99 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:27 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:14:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:27 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 1073741824 Jun 25 18:14:27 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:28 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9" returned: 0 in 0.894s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:28 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 Jun 25 18:14:28 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:28 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 1073741824" returned: 0 in 1.279s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:28 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 Jun 25 18:14:28 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:29 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9" returned: 1 in 1.169s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Downloaded image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}])) to volume 40ec9e78-1993-42e6-b8c1-84333c7c19a9 successfully. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Temporary image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f for user 4357ca1ce5544ed09046a0cce057893a is deleted. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Marking volume 40ec9e78-1993-42e6-b8c1-84333c7c19a9 as bootable. {{(pid=93767) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Copying metadata from image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f to 40ec9e78-1993-42e6-b8c1-84333c7c19a9. {{(pid=93767) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Creating volume glance metadata for volume 40ec9e78-1993-42e6-b8c1-84333c7c19a9 backed by image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93767) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a4d8d6-cfc2-4a5c-ae12-964b5f7d469e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17b3c0a-c8b4-4465-b62a-65f638026048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:29 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Volume volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 (40ec9e78-1993-42e6-b8c1-84333c7c19a9): created successfully Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17b3c0a-c8b4-4465-b62a-65f638026048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (38a9bcb3-f372-40c9-b36b-2944569a4e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2e86b454-cec5-4a08-a68a-bbcba4a3adda tempest-VolumesGetTest-1286722813 None] Created volume successfully. Jun 25 18:14:29 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99" returned: 0 in 0.941s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e68327-16a7-4781-ad85-d864a3deaf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002e6505-cd4f-40b2-bd3b-30c9a5f6bed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:29 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Volume volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 (b82512de-4d9a-4e74-8c8e-043e8c61ac99): created successfully Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002e6505-cd4f-40b2-bd3b-30c9a5f6bed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (e66e7628-20b6-4e2d-a395-cdaedc260ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1338550a-8e93-4521-a506-8e41cd64a0e7 tempest-VolumesActionsTest-1016561402 None] Created volume successfully. Jun 25 18:14:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Acquiring lock "cinder-b82512de-4d9a-4e74-8c8e-043e8c61ac99-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Lock "cinder-b82512de-4d9a-4e74-8c8e-043e8c61ac99-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Acquiring lock "cinder-quobyte-b82512de-4d9a-4e74-8c8e-043e8c61ac99" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Lock "cinder-quobyte-b82512de-4d9a-4e74-8c8e-043e8c61ac99" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f627919-8302-4294-b946-86e34ee834e6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (e2f86462-b741-41a7-92f4-d8167487c4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cafbf5f-07a6-4f67-82d8-495b1061a6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cafbf5f-07a6-4f67-82d8-495b1061a6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1509423397',display_name='tempest-VolumesGetTest-Volume-2136034360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fac301-6051-4703-8a86-92ab21b59779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:31Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cc67a8-a63b-477c-9930-5c2bdf9af07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cc67a8-a63b-477c-9930-5c2bdf9af07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:31 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 Jun 25 18:14:31 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00530637-fdc3-48f5-9707-71f18c68696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00530637-fdc3-48f5-9707-71f18c68696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fac301-6051-4703-8a86-92ab21b59779', 'volume_name': 'volume-80fac301-6051-4703-8a86-92ab21b59779', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c75ade3-3275-4779-ba8b-d82bdfff2e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c75ade3-3275-4779-ba8b-d82bdfff2e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd2b369-04e0-45c0-a7b8-91f9160278e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:31 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Volume 80fac301-6051-4703-8a86-92ab21b59779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fac301-6051-4703-8a86-92ab21b59779', 'volume_size': 1} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1509423397',display_name='tempest-VolumesGetTest-Volume-2136034360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fac301-6051-4703-8a86-92ab21b59779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735e25ed75b4c0392df0c69190659f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:31Z,use_quota=True,user_id='4357ca1ce5544ed09046a0cce057893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Creating volume 80fac301-6051-4703-8a86-92ab21b59779 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:31 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:14:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:31 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779 1073741824 Jun 25 18:14:31 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:32 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99" returned: 0 in 1.174s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:32 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99 Jun 25 18:14:32 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:32 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779 1073741824" returned: 0 in 1.172s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:32 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779 Jun 25 18:14:32 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:33 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b82512de-4d9a-4e74-8c8e-043e8c61ac99" returned: 0 in 0.953s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Lock "cinder-quobyte-b82512de-4d9a-4e74-8c8e-043e8c61ac99" released by "delete_volume" :: held 2.206s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Created reservations ['ff972645-6bdc-4fe6-8d6b-8350f566980a', '02941566-baa7-42ab-bc98-a1b36e6d651c', '3c786d49-d4fa-43bb-b496-08e61c309098', 'a290c37e-67ec-4e5e-948a-8898cbcb3bcf'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:33 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:33 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779" returned: 0 in 0.966s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:33 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd2b369-04e0-45c0-a7b8-91f9160278e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fac301-6051-4703-8a86-92ab21b59779', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2801c7-e8aa-446b-95bb-88a4486f6ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:33 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Volume volume-80fac301-6051-4703-8a86-92ab21b59779 (80fac301-6051-4703-8a86-92ab21b59779): created successfully Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2801c7-e8aa-446b-95bb-88a4486f6ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Flow 'volume_create_manager' (e2f86462-b741-41a7-92f4-d8167487c4db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:33 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f0b64448-e30b-4fd3-b8e4-e8e5e29c8d4d tempest-VolumesGetTest-1286722813 None] Created volume successfully. Jun 25 18:14:34 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.821s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:34 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:34 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Deleted volume successfully. Jun 25 18:14:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f03f3352-0bbf-44b6-b4b5-f64deadb62dc tempest-VolumesActionsTest-921851170 None] Lock "cinder-b82512de-4d9a-4e74-8c8e-043e8c61ac99-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-80fac301-6051-4703-8a86-92ab21b59779-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Lock "cinder-80fac301-6051-4703-8a86-92ab21b59779-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-quobyte-80fac301-6051-4703-8a86-92ab21b59779" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-80fac301-6051-4703-8a86-92ab21b59779" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:34 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dea0d3f-542f-45d5-aa52-e769057ff398]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:34 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779 Jun 25 18:14:34 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (730e8d3f-e312-4304-9211-1f4a1f90455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbda40a-3a19-4e96-9679-917af4ef3fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbda40a-3a19-4e96-9679-917af4ef3fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-125658252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea995ee7-e795-481a-8cab-156b7463bb3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:35Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bbb330-7796-450e-b01a-919b5e89f724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bbb330-7796-450e-b01a-919b5e89f724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2511c292-47e8-483b-b152-79057762176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2511c292-47e8-483b-b152-79057762176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea995ee7-e795-481a-8cab-156b7463bb3e', 'volume_name': 'volume-ea995ee7-e795-481a-8cab-156b7463bb3e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a43f6-3e31-4fb3-b74e-16c89497ca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a43f6-3e31-4fb3-b74e-16c89497ca09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96793902-40d0-4f2f-8fdf-84e946a7f984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:35 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Volume ea995ee7-e795-481a-8cab-156b7463bb3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea995ee7-e795-481a-8cab-156b7463bb3e', 'volume_size': 1} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-125658252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea995ee7-e795-481a-8cab-156b7463bb3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:35Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Creating volume ea995ee7-e795-481a-8cab-156b7463bb3e {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:35 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:35 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e 1073741824 Jun 25 18:14:35 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:35 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779" returned: 0 in 1.123s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:35 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779 Jun 25 18:14:35 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:36 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e 1073741824" returned: 0 in 0.998s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:36 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e Jun 25 18:14:36 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:36 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-80fac301-6051-4703-8a86-92ab21b59779" returned: 0 in 0.784s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-80fac301-6051-4703-8a86-92ab21b59779" released by "delete_volume" :: held 1.971s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Created reservations ['c9ee3681-f598-414f-b95b-52985a4ef4e2', '9ac7d010-0e87-45eb-b862-e47e867ab4af', '16cbbd14-f613-430e-9316-2510bb4898be', '33d01f2d-fbea-4928-ad1a-25586a0d8a36'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:36 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:36 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-40ec9e78-1993-42e6-b8c1-84333c7c19a9-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Lock "cinder-40ec9e78-1993-42e6-b8c1-84333c7c19a9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Acquiring lock "cinder-quobyte-40ec9e78-1993-42e6-b8c1-84333c7c19a9" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-40ec9e78-1993-42e6-b8c1-84333c7c19a9" acquired by "delete_volume" :: waited 0.014s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f20736-ba7c-42b3-83ed-fe3c809e9cb5]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:37 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 Jun 25 18:14:37 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:37 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e" returned: 0 in 0.795s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96793902-40d0-4f2f-8fdf-84e946a7f984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea995ee7-e795-481a-8cab-156b7463bb3e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922439b9-385e-4d8f-9262-089abe66cbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:37 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Volume volume-ea995ee7-e795-481a-8cab-156b7463bb3e (ea995ee7-e795-481a-8cab-156b7463bb3e): created successfully Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922439b9-385e-4d8f-9262-089abe66cbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (730e8d3f-e312-4304-9211-1f4a1f90455a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b53daf03-591a-476b-baa3-0b06afc7accc tempest-VolumesActionsTest-1016561402 None] Created volume successfully. Jun 25 18:14:37 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.733s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Deleted volume successfully. Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b14f2cdf-d96b-4f5e-a0a9-541a2e32e22f tempest-VolumesGetTest-1286722813 None] Lock "cinder-80fac301-6051-4703-8a86-92ab21b59779-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:37 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9" returned: 0 in 0.904s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:38 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 Jun 25 18:14:38 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Acquiring lock "cinder-ea995ee7-e795-481a-8cab-156b7463bb3e-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Lock "cinder-ea995ee7-e795-481a-8cab-156b7463bb3e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=72,cinder:UPDATE=117,cinder:INSERT=29,cinder:DELETE=11 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=91,cinder:UPDATE=100,cinder:DELETE=8,cinder:INSERT=32 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Acquiring lock "cinder-quobyte-ea995ee7-e795-481a-8cab-156b7463bb3e" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Lock "cinder-quobyte-ea995ee7-e795-481a-8cab-156b7463bb3e" acquired by "delete_volume" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe59006-f66a-4d2c-91b5-13b3409969d6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:39 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e Jun 25 18:14:39 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:39 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9" returned: 1 in 1.688s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:14:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:39 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9 Jun 25 18:14:39 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:40 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:40 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:40 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e" returned: 0 in 1.422s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:40 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e Jun 25 18:14:40 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:40 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40ec9e78-1993-42e6-b8c1-84333c7c19a9" returned: 0 in 1.210s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Lock "cinder-quobyte-40ec9e78-1993-42e6-b8c1-84333c7c19a9" released by "delete_volume" :: held 3.882s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:40 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Created reservations ['abc1de73-d2d0-41a8-b5a2-88dcf4d3d825', 'eb900009-b163-4c11-a8d5-b542a8cedc28', '63ebac99-4d78-46d5-973c-490f51c1533f', 'c31d4d20-efb0-43e5-b879-fd7bde0f749a'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:41 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:41 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:42 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ea995ee7-e795-481a-8cab-156b7463bb3e" returned: 0 in 1.400s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Lock "cinder-quobyte-ea995ee7-e795-481a-8cab-156b7463bb3e" released by "delete_volume" :: held 2.929s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Created reservations ['3b9da9e6-929f-4bf3-aa70-4e83c4a1fffd', 'db694b3f-5783-4332-844f-227d4b1e9b32', 'c874a8a0-8e84-4e5f-97fc-ad849391f76f', '66ef1ec0-5874-497c-a1e0-3033a5acf1dd'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:42 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 2.016s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:14:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:14:42 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:42 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:43 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.945s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:43 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:43 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Deleted volume successfully. Jun 25 18:14:43 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ca9d7b02-8c00-4588-ad73-b522a408fa2e tempest-VolumesGetTest-1286722813 None] Lock "cinder-40ec9e78-1993-42e6-b8c1-84333c7c19a9-delete_volume" released by "delete_volume" :: held 6.359s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:44 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.633s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Deleted volume successfully. Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f276c15b-a1d2-40e6-b499-81c19720ce93 tempest-VolumesActionsTest-921851170 None] Lock "cinder-ea995ee7-e795-481a-8cab-156b7463bb3e-delete_volume" released by "delete_volume" :: held 5.193s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (91ba875d-c8fa-4d05-b4d5-be7863fc4892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a558aba6-7778-4dff-8689-4e02087a2ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a558aba6-7778-4dff-8689-4e02087a2ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1641106789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779a0986-0cfd-4515-94e6-990ff72b11b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:44Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd1fecc-1e3c-4a49-b285-0a21626ff75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd1fecc-1e3c-4a49-b285-0a21626ff75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079f6d9-71f9-44ac-9a16-604e8a232c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079f6d9-71f9-44ac-9a16-604e8a232c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779a0986-0cfd-4515-94e6-990ff72b11b0', 'volume_name': 'volume-779a0986-0cfd-4515-94e6-990ff72b11b0', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333ba2e7-c09c-4898-8abf-47d226027811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333ba2e7-c09c-4898-8abf-47d226027811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3523cc-0f30-49b8-a608-7f592049d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:44 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Volume 779a0986-0cfd-4515-94e6-990ff72b11b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779a0986-0cfd-4515-94e6-990ff72b11b0', 'volume_size': 1} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1641106789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779a0986-0cfd-4515-94e6-990ff72b11b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdebc0f522db4d2bbe6c5f49c98ecd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:44Z,use_quota=True,user_id='a24e96c900654197866d5d96b43d6910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Creating volume 779a0986-0cfd-4515-94e6-990ff72b11b0 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:44 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:14:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:44 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0 1073741824 Jun 25 18:14:44 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:46 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0 1073741824" returned: 0 in 1.924s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:46 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0 Jun 25 18:14:46 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:48 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0" returned: 0 in 1.787s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] <== create_volume: return (3799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.802s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3523cc-0f30-49b8-a608-7f592049d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779a0986-0cfd-4515-94e6-990ff72b11b0', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94123685-4aba-4589-972a-caa273a52300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Volume volume-779a0986-0cfd-4515-94e6-990ff72b11b0 (779a0986-0cfd-4515-94e6-990ff72b11b0): created successfully Jun 25 18:14:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94123685-4aba-4589-972a-caa273a52300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Flow 'volume_create_manager' (91ba875d-c8fa-4d05-b4d5-be7863fc4892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:48 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4f62185b-c374-4e77-b86e-634a4e04e47b tempest-VolumesActionsTest-1016561402 None] Created volume successfully. Jun 25 18:14:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "cinder-779a0986-0cfd-4515-94e6-990ff72b11b0-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-779a0986-0cfd-4515-94e6-990ff72b11b0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "cinder-quobyte-779a0986-0cfd-4515-94e6-990ff72b11b0" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-quobyte-779a0986-0cfd-4515-94e6-990ff72b11b0" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:51 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[160c417b-06f7-4216-854e-d0f441be017b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:51 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0 Jun 25 18:14:51 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:52 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0" returned: 0 in 1.146s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:52 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0 Jun 25 18:14:52 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:53 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-779a0986-0cfd-4515-94e6-990ff72b11b0" returned: 0 in 0.997s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-quobyte-779a0986-0cfd-4515-94e6-990ff72b11b0" released by "delete_volume" :: held 2.236s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Created reservations ['f306ad1f-ec57-4777-b64c-932e74a5d33e', 'a8cdebfb-0789-4b21-9e74-f0836e02588e', 'bd9f7576-7193-4c7f-b946-f2b05f1f8e92', 'f5dbae87-0075-41cd-9760-616df9c58696'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:53 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:14:53 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Flow 'volume_create_manager' (fb076cdd-5dd9-4fc7-a735-0c975717ba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b92c1c-fea6-4f76-98f9-172b1c194a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b92c1c-fea6-4f76-98f9-172b1c194a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-228659004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee36538a-e80e-4b01-97b2-398d69112982,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7bd02d77f45cb81d71e5fefde4bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:54Z,use_quota=True,user_id='8d2412d041ed475b9cf28a47612c76e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bb8590-ab1b-49df-8c9f-ae30e2c57999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bb8590-ab1b-49df-8c9f-ae30e2c57999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76581ae2-9aff-4431-ade2-a2a7c05d6f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76581ae2-9aff-4431-ade2-a2a7c05d6f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee36538a-e80e-4b01-97b2-398d69112982', 'volume_name': 'volume-ee36538a-e80e-4b01-97b2-398d69112982', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1982a719-fe36-46bf-a7db-1cdbfe6df71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1982a719-fe36-46bf-a7db-1cdbfe6df71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c23912e-b5cf-4144-a702-37d9aa6abd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:53 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Volume ee36538a-e80e-4b01-97b2-398d69112982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee36538a-e80e-4b01-97b2-398d69112982', 'volume_size': 1} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-228659004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee36538a-e80e-4b01-97b2-398d69112982,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7bd02d77f45cb81d71e5fefde4bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:54Z,use_quota=True,user_id='8d2412d041ed475b9cf28a47612c76e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Creating volume ee36538a-e80e-4b01-97b2-398d69112982 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:53 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:14:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:54 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982 1073741824 Jun 25 18:14:54 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:54 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.972s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:54 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:54 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Deleted volume successfully. Jun 25 18:14:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-25933e8d-3fa7-48c1-a89b-9324c0cd0713 tempest-VolumesActionsTest-1016561402 None] Lock "cinder-779a0986-0cfd-4515-94e6-990ff72b11b0-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:55 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982 1073741824" returned: 0 in 1.244s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:55 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982 Jun 25 18:14:55 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:55 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982" returned: 0 in 0.725s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c23912e-b5cf-4144-a702-37d9aa6abd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee36538a-e80e-4b01-97b2-398d69112982', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac4fd95-8524-4167-b303-180327bbc62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:56 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Volume volume-ee36538a-e80e-4b01-97b2-398d69112982 (ee36538a-e80e-4b01-97b2-398d69112982): created successfully Jun 25 18:14:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac4fd95-8524-4167-b303-180327bbc62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Flow 'volume_create_manager' (fb076cdd-5dd9-4fc7-a735-0c975717ba3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:56 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-cd8bbd57-c2ec-4daf-b273-a909128dcd59 tempest-VolumesListTestJSON-1676628933 None] Created volume successfully. Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Flow 'volume_create_manager' (2574219a-e2f6-4885-96e8-ddd7fcb37a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88257e3-c693-440b-8769-bb4ea86b5d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88257e3-c693-440b-8769-bb4ea86b5d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2047462289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd1bac1-e3ec-48ba-9e1d-8122b8648366,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7bd02d77f45cb81d71e5fefde4bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:58Z,use_quota=True,user_id='8d2412d041ed475b9cf28a47612c76e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfe8ba9-03ae-4771-8a8e-784d62867309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfe8ba9-03ae-4771-8a8e-784d62867309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664bdac5-4647-4278-a684-713b6dac6662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664bdac5-4647-4278-a684-713b6dac6662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd1bac1-e3ec-48ba-9e1d-8122b8648366', 'volume_name': 'volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bd0f62-b949-415d-ab19-df0a36b7a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bd0f62-b949-415d-ab19-df0a36b7a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3f7809-9386-47b5-9094-0e626f61a659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:57 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Volume efd1bac1-e3ec-48ba-9e1d-8122b8648366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366', 'volume_size': 1} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2047462289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd1bac1-e3ec-48ba-9e1d-8122b8648366,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7bd02d77f45cb81d71e5fefde4bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:58Z,use_quota=True,user_id='8d2412d041ed475b9cf28a47612c76e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Creating volume efd1bac1-e3ec-48ba-9e1d-8122b8648366 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:57 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:14:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:57 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 1073741824 Jun 25 18:14:57 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:59 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 1073741824" returned: 0 in 1.327s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:59 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 Jun 25 18:14:59 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:00 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366" returned: 0 in 1.027s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] <== create_volume: return (2426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.429s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3f7809-9386-47b5-9094-0e626f61a659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7236ac-6a02-4367-b7f5-97d3c8cdc59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:00 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Volume volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 (efd1bac1-e3ec-48ba-9e1d-8122b8648366): created successfully Jun 25 18:15:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7236ac-6a02-4367-b7f5-97d3c8cdc59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Flow 'volume_create_manager' (2574219a-e2f6-4885-96e8-ddd7fcb37a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:00 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0d145ac5-0a2c-4c09-a798-ffdc5d61fd21 tempest-VolumesListTestJSON-1676628933 None] Created volume successfully. Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Flow 'volume_create_manager' (ac37e1e9-7d9f-4db0-a2ab-f1d488dbd886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9e9c7a-dceb-43d0-a846-808ce9b6e407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9e9c7a-dceb-43d0-a846-808ce9b6e407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1774395977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7bd02d77f45cb81d71e5fefde4bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:01Z,use_quota=True,user_id='8d2412d041ed475b9cf28a47612c76e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12833749-79c2-4cde-884d-d7564b207eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12833749-79c2-4cde-884d-d7564b207eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a856fb65-d47f-43f8-851f-fb6fa48cc9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a856fb65-d47f-43f8-851f-fb6fa48cc9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990', 'volume_name': 'volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b441f51f-46f0-4e2c-834f-8aff0607c02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b441f51f-46f0-4e2c-834f-8aff0607c02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c454d4-1b95-47b4-95d4-0d2573dde91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:01 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Volume c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990', 'volume_size': 1} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1774395977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7bd02d77f45cb81d71e5fefde4bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:01Z,use_quota=True,user_id='8d2412d041ed475b9cf28a47612c76e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Creating volume c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:01 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:15:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:01 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 1073741824 Jun 25 18:15:01 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:02 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 1073741824" returned: 0 in 1.094s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:02 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 Jun 25 18:15:02 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:03 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990" returned: 0 in 0.812s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c454d4-1b95-47b4-95d4-0d2573dde91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae71f65b-e37b-4d4f-a22b-894fb73bf24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:03 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Volume volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 (c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990): created successfully Jun 25 18:15:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae71f65b-e37b-4d4f-a22b-894fb73bf24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Flow 'volume_create_manager' (ac37e1e9-7d9f-4db0-a2ab-f1d488dbd886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:03 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f46afcfd-e70a-452e-ac39-6d20030aa546 tempest-VolumesListTestJSON-1676628933 None] Created volume successfully. Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "cinder-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "cinder-quobyte-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-quobyte-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990" acquired by "delete_volume" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b01711b-3347-4a3f-8853-bb31c7d8780d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:08 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 Jun 25 18:15:08 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Flow 'volume_create_manager' (0d5adbfd-a116-491a-b622-c7d0776563a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e8201f-3b5d-4bfa-82ed-f810773fc50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e8201f-3b5d-4bfa-82ed-f810773fc50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-869756270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb08ee8e-ed56-46a3-82b4-fad933a80644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ab74d92214502bf8a96c47a2d2c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:09Z,use_quota=True,user_id='410cbc4fbc7045cfbdb651bd9412afe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7de764-466c-4d12-a232-821579de5a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7de764-466c-4d12-a232-821579de5a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89fa147-b9f2-433a-82c4-81abfc9790e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89fa147-b9f2-433a-82c4-81abfc9790e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb08ee8e-ed56-46a3-82b4-fad933a80644', 'volume_name': 'volume-eb08ee8e-ed56-46a3-82b4-fad933a80644', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec2056e-b3d7-4d80-91a7-175275add396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec2056e-b3d7-4d80-91a7-175275add396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73639eda-cd87-492b-940b-8ee61d0ef995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:08 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Volume eb08ee8e-ed56-46a3-82b4-fad933a80644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb08ee8e-ed56-46a3-82b4-fad933a80644', 'volume_size': 1} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-869756270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb08ee8e-ed56-46a3-82b4-fad933a80644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ab74d92214502bf8a96c47a2d2c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:09Z,use_quota=True,user_id='410cbc4fbc7045cfbdb651bd9412afe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Creating volume eb08ee8e-ed56-46a3-82b4-fad933a80644 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:08 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:15:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:08 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 1073741824 Jun 25 18:15:08 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:09 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990" returned: 0 in 1.078s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:09 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990 Jun 25 18:15:09 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:10 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 1073741824" returned: 0 in 1.314s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:10 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 Jun 25 18:15:10 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:10 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990" returned: 0 in 0.990s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-quobyte-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990" released by "delete_volume" :: held 2.161s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Created reservations ['c15ce426-1f4b-4ab1-8482-d864253ac754', 'ee6c1bb5-f370-443e-ab28-8a51e7404cd7', '901a6f9e-b734-4aa4-866f-53435ba5ef2f', '4f243075-52d7-4754-a358-7d42c5335440'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:10 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:15:10 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:11 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644" returned: 0 in 1.082s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] <== create_volume: return (2462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.466s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73639eda-cd87-492b-940b-8ee61d0ef995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb08ee8e-ed56-46a3-82b4-fad933a80644', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50e9170-da0a-42eb-b449-17d01de8d71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:11 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Volume volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 (eb08ee8e-ed56-46a3-82b4-fad933a80644): created successfully Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50e9170-da0a-42eb-b449-17d01de8d71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Flow 'volume_create_manager' (0d5adbfd-a116-491a-b622-c7d0776563a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:11 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-03a89c42-aad8-475e-8eef-958b8470be3a tempest-AttachVolumeNegativeTest-1899965128 None] Created volume successfully. Jun 25 18:15:11 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.889s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:11 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Deleted volume successfully. Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cd2ab497-372e-4609-9889-3b1f4a63663b tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-c4bd8531-21e1-4fb3-a0d4-6fc1a45ea990-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "cinder-efd1bac1-e3ec-48ba-9e1d-8122b8648366-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-efd1bac1-e3ec-48ba-9e1d-8122b8648366-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "cinder-quobyte-efd1bac1-e3ec-48ba-9e1d-8122b8648366" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-quobyte-efd1bac1-e3ec-48ba-9e1d-8122b8648366" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bc42eb-bf1a-4cff-9f6b-c3760b6fadaf]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:12 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 Jun 25 18:15:12 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:12 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366" returned: 0 in 0.935s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:12 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366 Jun 25 18:15:12 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:13 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-efd1bac1-e3ec-48ba-9e1d-8122b8648366" returned: 0 in 0.700s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-quobyte-efd1bac1-e3ec-48ba-9e1d-8122b8648366" released by "delete_volume" :: held 1.681s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:13 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Created reservations ['192b65ef-27c7-4dad-9e05-4f9d4ff23e5c', 'd2a72069-2aab-4fc9-aefe-1fe178e94c18', 'b132e176-aa23-4887-9995-7def1e49948d', 'ee118009-297d-4f9f-8ae7-bc34a5e165b6'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:13 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:15:13 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "cinder-ee36538a-e80e-4b01-97b2-398d69112982-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-ee36538a-e80e-4b01-97b2-398d69112982-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "cinder-quobyte-ee36538a-e80e-4b01-97b2-398d69112982" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-quobyte-ee36538a-e80e-4b01-97b2-398d69112982" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:14 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba886a4-6801-46ff-add4-9592884fefdf]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:14 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982 Jun 25 18:15:14 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:14 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.918s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:14 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:14 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Deleted volume successfully. Jun 25 18:15:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3ed298ce-3095-468b-bbdd-29001ebe191c tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-efd1bac1-e3ec-48ba-9e1d-8122b8648366-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f025c6eb-664d-413d-aeaf-05dce62989dc req-375b8c0c-dc94-484c-a455-10936195d631 tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f025c6eb-664d-413d-aeaf-05dce62989dc req-375b8c0c-dc94-484c-a455-10936195d631 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:15 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b36b1-37ec-4d1c-8a8e-37fa4f73a804]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f025c6eb-664d-413d-aeaf-05dce62989dc req-375b8c0c-dc94-484c-a455-10936195d631 tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:15 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 Jun 25 18:15:15 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:15 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982" returned: 0 in 1.058s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:15 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982 Jun 25 18:15:15 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:16 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f025c6eb-664d-413d-aeaf-05dce62989dc req-375b8c0c-dc94-484c-a455-10936195d631 tempest-AttachVolumeNegativeTest-1899965128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644" returned: 0 in 1.181s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f025c6eb-664d-413d-aeaf-05dce62989dc req-375b8c0c-dc94-484c-a455-10936195d631 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.227s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-f025c6eb-664d-413d-aeaf-05dce62989dc req-375b8c0c-dc94-484c-a455-10936195d631 tempest-AttachVolumeNegativeTest-1899965128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-eb08ee8e-ed56-46a3-82b4-fad933a80644', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f659948-8cef-4844-8793-272127066a66', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:15:16 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ee36538a-e80e-4b01-97b2-398d69112982" returned: 0 in 1.084s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-quobyte-ee36538a-e80e-4b01-97b2-398d69112982" released by "delete_volume" :: held 2.224s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:16 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-f025c6eb-664d-413d-aeaf-05dce62989dc req-375b8c0c-dc94-484c-a455-10936195d631 tempest-AttachVolumeNegativeTest-1899965128 None] attachment_update completed successfully. Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Created reservations ['9f7c258a-b239-4320-b322-38cb85eab20d', '6c9b7348-3125-477c-a59b-d25fd7dd5d27', '3cba4d7e-17ce-4b0a-b772-5f74ae3578bd', 'af51ce69-9a15-4be8-9d4e-3afdf9893854'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:16 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:15:16 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:17 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.970s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:17 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Deleted volume successfully. Jun 25 18:15:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1baca9c0-3e54-4982-bb1e-e6be9140589d tempest-VolumesListTestJSON-1676628933 None] Lock "cinder-ee36538a-e80e-4b01-97b2-398d69112982-delete_volume" released by "delete_volume" :: held 3.554s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Flow 'volume_create_manager' (d8ddf6a3-8eb8-40cd-8d5d-32f88995c76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946e41b7-f80f-4e9e-ac6f-e1899966459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946e41b7-f80f-4e9e-ac6f-e1899966459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-18030101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8d7545-0934-4cab-843e-a9885461d6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a3009ef91a43fb9ad32aec5d4ebf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:19Z,use_quota=True,user_id='60bcaf944d244d1dbd0585dede567b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d92cfc4-0109-4a86-a8b4-e599c5c47d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d92cfc4-0109-4a86-a8b4-e599c5c47d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce752edc-39b1-439a-9228-b0e95be55e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce752edc-39b1-439a-9228-b0e95be55e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8d7545-0934-4cab-843e-a9885461d6f8', 'volume_name': 'volume-5a8d7545-0934-4cab-843e-a9885461d6f8', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efffa32-fb37-4895-bbf6-fc53c9f5fb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efffa32-fb37-4895-bbf6-fc53c9f5fb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a432c6f8-938c-4d21-8dc7-8018d2412d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:19 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Volume 5a8d7545-0934-4cab-843e-a9885461d6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8d7545-0934-4cab-843e-a9885461d6f8', 'volume_size': 1} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-18030101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8d7545-0934-4cab-843e-a9885461d6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a3009ef91a43fb9ad32aec5d4ebf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:19Z,use_quota=True,user_id='60bcaf944d244d1dbd0585dede567b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Creating volume 5a8d7545-0934-4cab-843e-a9885461d6f8 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:19 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:15:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:19 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8 1073741824 Jun 25 18:15:19 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:20 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8 1073741824" returned: 0 in 1.023s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:20 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8 Jun 25 18:15:20 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:21 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8" returned: 0 in 0.740s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a432c6f8-938c-4d21-8dc7-8018d2412d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8d7545-0934-4cab-843e-a9885461d6f8', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f117f57b-64d2-41b0-8cd0-69f4c41fb90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:21 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Volume volume-5a8d7545-0934-4cab-843e-a9885461d6f8 (5a8d7545-0934-4cab-843e-a9885461d6f8): created successfully Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f117f57b-64d2-41b0-8cd0-69f4c41fb90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Flow 'volume_create_manager' (d8ddf6a3-8eb8-40cd-8d5d-32f88995c76c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:21 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9506b8ae-868e-42d2-b6c7-904a8ed56206 tempest-AbsoluteLimitsTests-1533596105 None] Created volume successfully. Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Acquiring lock "cinder-5a8d7545-0934-4cab-843e-a9885461d6f8-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Lock "cinder-5a8d7545-0934-4cab-843e-a9885461d6f8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Acquiring lock "cinder-quobyte-5a8d7545-0934-4cab-843e-a9885461d6f8" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Lock "cinder-quobyte-5a8d7545-0934-4cab-843e-a9885461d6f8" acquired by "delete_volume" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da38ff6-75a0-4b04-a240-d4907b0c298c]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:21 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8 Jun 25 18:15:21 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:22 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8" returned: 0 in 0.990s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:22 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8 Jun 25 18:15:22 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:23 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5a8d7545-0934-4cab-843e-a9885461d6f8" returned: 0 in 0.880s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Lock "cinder-quobyte-5a8d7545-0934-4cab-843e-a9885461d6f8" released by "delete_volume" :: held 1.949s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Created reservations ['40577636-985c-4c21-97ea-9d5c0fb22c52', '9dec0e01-c061-411a-9703-2649933abe37', '767dd6d4-6aee-40a3-9674-220d5735b662', '685b3c0b-c374-47f4-bab9-dee44d7a34b9'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-713f8de5-fe0d-4396-80b5-72d7e5956a4e req-ec968fd7-d959-451c-931d-2a80ce4b3933 tempest-AttachVolumeNegativeTest-1899965128 None] Terminate volume connection completed successfully. Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-713f8de5-fe0d-4396-80b5-72d7e5956a4e req-ec968fd7-d959-451c-931d-2a80ce4b3933 tempest-AttachVolumeNegativeTest-1899965128 None] Deleting attachment 2f659948-8cef-4844-8793-272127066a66. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:23 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:15:23 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:24 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.107s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:24 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:24 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Deleted volume successfully. Jun 25 18:15:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-182d7d4b-7359-4858-9e47-84f8743e2783 tempest-AbsoluteLimitsTests-1533596105 None] Lock "cinder-5a8d7545-0934-4cab-843e-a9885461d6f8-delete_volume" released by "delete_volume" :: held 3.528s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:33 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=47,cinder:INSERT=19,cinder:UPDATE=85,cinder:DELETE=5 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=58,cinder:INSERT=15,cinder:UPDATE=65,cinder:DELETE=8 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Flow 'volume_create_manager' (3a345794-58d2-4a1e-b361-2b34902b239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858cd0c9-2f48-499e-b417-53b8e2d11f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858cd0c9-2f48-499e-b417-53b8e2d11f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-873629927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8f9bea-4691-4809-81fb-3f5c9de6377a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcab57e1c75442a0bd53762cf39354af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:35Z,use_quota=True,user_id='4ff0a33487754463ac0e5a1854cbdf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ade029-68be-49a2-ba92-02ccb2c7196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ade029-68be-49a2-ba92-02ccb2c7196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a60d03-7f0e-49a1-a070-2217ed444316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a60d03-7f0e-49a1-a070-2217ed444316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8f9bea-4691-4809-81fb-3f5c9de6377a', 'volume_name': 'volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb4f913-368f-4fe0-b34e-2afed2b1a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb4f913-368f-4fe0-b34e-2afed2b1a563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98b39cd-dcad-43fc-924d-0039ef0b04b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:35 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Volume 3b8f9bea-4691-4809-81fb-3f5c9de6377a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a', 'volume_size': 1} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-873629927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8f9bea-4691-4809-81fb-3f5c9de6377a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcab57e1c75442a0bd53762cf39354af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:35Z,use_quota=True,user_id='4ff0a33487754463ac0e5a1854cbdf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Creating volume 3b8f9bea-4691-4809-81fb-3f5c9de6377a {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:35 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:15:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:35 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a 1073741824 Jun 25 18:15:35 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:37 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a 1073741824" returned: 0 in 1.953s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:37 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a Jun 25 18:15:37 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:39 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a" returned: 0 in 1.781s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] <== create_volume: return (3852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.855s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98b39cd-dcad-43fc-924d-0039ef0b04b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd0382d-01c3-47a2-a99e-ff3d63598ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Volume volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a (3b8f9bea-4691-4809-81fb-3f5c9de6377a): created successfully Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd0382d-01c3-47a2-a99e-ff3d63598ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Flow 'volume_create_manager' (3a345794-58d2-4a1e-b361-2b34902b239f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-45c076bd-456a-4098-abf8-daf7939ba5dd tempest-VolumesTransfersTest-1304490485 None] Created volume successfully. Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (d7e3209f-74a1-49fb-8998-91d51b5ee441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9edb7c-fcb9-4f78-981e-97aeebde61d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9edb7c-fcb9-4f78-981e-97aeebde61d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-110379993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76fe6ac-4255-418c-9e7d-9dbdaf0683c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab91ceffd4f04041be3d9257295ed2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:40Z,use_quota=True,user_id='41dfdf98c6bf4acaa23b8af9772d9b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14cde08-1706-421d-ab9a-245ae8651a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14cde08-1706-421d-ab9a-245ae8651a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a92c659-e651-4f0a-aaa7-07f8e311bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a92c659-e651-4f0a-aaa7-07f8e311bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76fe6ac-4255-418c-9e7d-9dbdaf0683c3', 'volume_name': 'volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b51dac-c35b-4a10-8efb-a2e8ca84f415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b51dac-c35b-4a10-8efb-a2e8ca84f415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0458c74-20e8-49ee-9101-b4dc20f2054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Volume c76fe6ac-4255-418c-9e7d-9dbdaf0683c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3', 'volume_size': 1} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-110379993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76fe6ac-4255-418c-9e7d-9dbdaf0683c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab91ceffd4f04041be3d9257295ed2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:40Z,use_quota=True,user_id='41dfdf98c6bf4acaa23b8af9772d9b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Creating volume c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:40 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:40 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 1073741824 Jun 25 18:15:40 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:40 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:15:40 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:41 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1248a80e-1bd1-4ef9-8e52-82e0fa107276 tempest-VolumesTransfersTest-2131957102 None] Transfer volume completed successfully. Jun 25 18:15:41 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 1073741824" returned: 0 in 1.593s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:41 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 Jun 25 18:15:41 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:41 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.287s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:15:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:15:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Acquiring lock "cinder-3b8f9bea-4691-4809-81fb-3f5c9de6377a-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Lock "cinder-3b8f9bea-4691-4809-81fb-3f5c9de6377a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Acquiring lock "cinder-quobyte-3b8f9bea-4691-4809-81fb-3f5c9de6377a" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Lock "cinder-quobyte-3b8f9bea-4691-4809-81fb-3f5c9de6377a" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c721d2d-b7fa-482f-9805-2699979c8b69]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:42 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" returned: 0 in 0.926s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] <== create_volume: return (2607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.613s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:42 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a Jun 25 18:15:42 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0458c74-20e8-49ee-9101-b4dc20f2054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4df789-ac93-4807-9949-485b0ea9a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:42 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Volume volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 (c76fe6ac-4255-418c-9e7d-9dbdaf0683c3): created successfully Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4df789-ac93-4807-9949-485b0ea9a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (d7e3209f-74a1-49fb-8998-91d51b5ee441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:42 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-01078e22-bcc9-46d9-b7c0-5a068d957855 tempest-VolumesSnapshotTestJSON-685795700 None] Created volume successfully. Jun 25 18:15:43 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a" returned: 0 in 1.064s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:43 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a Jun 25 18:15:43 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Creating offline snapshot c1cf802b-1ab0-44f7-87ab-f0232f191164 of volume c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:15:43 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40081ff-6db4-4e39-8ff4-9f16307f1a12]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:43 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 Jun 25 18:15:43 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:44 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3b8f9bea-4691-4809-81fb-3f5c9de6377a" returned: 0 in 0.888s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Lock "cinder-quobyte-3b8f9bea-4691-4809-81fb-3f5c9de6377a" released by "delete_volume" :: held 2.005s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Created reservations ['761517f9-c510-48ee-aa1c-1c197396a368', '10d4847c-3e30-4f2f-998c-5b56eee7a346', '8dab8c69-c0a8-43e1-9d6e-356b07fc3ec3', '40849fa9-eaf6-4a49-a321-c0b8251de5ae'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:44 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:15:44 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:44 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" returned: 0 in 1.092s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:44 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 1G Jun 25 18:15:44 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:45 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.770s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:45 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Deleted volume successfully. Jun 25 18:15:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5d0e91c8-0f49-4fde-b08e-02353f5a6b7d tempest-VolumesTransfersTest-385886352 None] Lock "cinder-3b8f9bea-4691-4809-81fb-3f5c9de6377a-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:45 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 1G" returned: 0 in 1.101s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:45 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 Jun 25 18:15:45 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Flow 'volume_create_manager' (a4cc32c7-3593-4ebc-ade8-fef4e68024f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38aacd39-3c8b-483b-8716-014f53afd104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38aacd39-3c8b-483b-8716-014f53afd104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1575081743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c3a7d2-f6be-41bb-a524-aa27f6d30e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcab57e1c75442a0bd53762cf39354af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:46Z,use_quota=True,user_id='4ff0a33487754463ac0e5a1854cbdf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f932b76-9534-46d9-a88b-caffbf632cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f932b76-9534-46d9-a88b-caffbf632cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd79234f-9059-4ebd-b03b-6ee3322227f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd79234f-9059-4ebd-b03b-6ee3322227f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c3a7d2-f6be-41bb-a524-aa27f6d30e45', 'volume_name': 'volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43905e8d-ac76-480d-8a07-ec5e60575cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43905e8d-ac76-480d-8a07-ec5e60575cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa665180-8833-4561-9473-98b2f363d344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:46 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Volume d1c3a7d2-f6be-41bb-a524-aa27f6d30e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45', 'volume_size': 1} Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:46 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164" returned: 0 in 0.847s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:46 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 is being set with open permissions: ugo+rw Jun 25 18:15:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:46 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 Jun 25 18:15:46 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:47 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164" returned: 0 in 0.738s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:47 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.info Jun 25 18:15:47 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:48 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.info" returned: 0 in 0.828s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:48 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.info is being set with open permissions: ugo+rw Jun 25 18:15:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:48 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.info Jun 25 18:15:48 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:49 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.info" returned: 0 in 0.766s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.501s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.525s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1575081743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c3a7d2-f6be-41bb-a524-aa27f6d30e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcab57e1c75442a0bd53762cf39354af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:46Z,use_quota=True,user_id='4ff0a33487754463ac0e5a1854cbdf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Creating volume d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:49 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:15:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:49 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 1073741824 Jun 25 18:15:49 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:49 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4787247d-5b93-4f85-880d-47b6f71d1aa8 tempest-VolumesSnapshotTestJSON-685795700 None] Create snapshot completed successfully Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-c1cf802b-1ab0-44f7-87ab-f0232f191164-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-c1cf802b-1ab0-44f7-87ab-f0232f191164-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:50 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 1073741824" returned: 0 in 1.111s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-c1cf802b-1ab0-44f7-87ab-f0232f191164" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-c1cf802b-1ab0-44f7-87ab-f0232f191164" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Deleting offline snapshot c1cf802b-1ab0-44f7-87ab-f0232f191164 of volume c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:15:50 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 Jun 25 18:15:50 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] snapshot_file for this snap is: volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5753ce5-1b14-46a6-8995-6f83aeabc841]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:50 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 Jun 25 18:15:50 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:51 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45" returned: 0 in 1.264s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] <== create_volume: return (2444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.452s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa665180-8833-4561-9473-98b2f363d344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56e99f1-ad38-43ba-94ba-5be3746a91c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:51 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Volume volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 (d1c3a7d2-f6be-41bb-a524-aa27f6d30e45): created successfully Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56e99f1-ad38-43ba-94ba-5be3746a91c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Flow 'volume_create_manager' (a4cc32c7-3593-4ebc-ade8-fef4e68024f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Flow 'volume_create_manager' (04c55d26-42ea-44ed-8339-6af4bbd771eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c4c409-9321-4ba4-ae43-e8df6a4ae758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-cade37d3-6325-41a9-b859-68d5e789667e tempest-VolumesTransfersTest-1304490485 None] Created volume successfully. Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c4c409-9321-4ba4-ae43-e8df6a4ae758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1300192082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01486fdb-6e51-40b8-abf8-c8ba0fe14502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650efe30f4aa4d20b6b7e5b3b57dd06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:51Z,use_quota=True,user_id='845bbbdab1714677b3f49a1a0b8d06a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:51 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74040f9c-19e3-4561-bc68-a1912a51afa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74040f9c-19e3-4561-bc68-a1912a51afa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c2c3ee-2e75-4a7c-b103-4e0da09a77dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c2c3ee-2e75-4a7c-b103-4e0da09a77dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01486fdb-6e51-40b8-abf8-c8ba0fe14502', 'volume_name': 'volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bb59b2-929f-473a-8fd6-cf4c270b8dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bb59b2-929f-473a-8fd6-cf4c270b8dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3459c3-72f7-4603-8bc9-126ef200b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:51 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Volume 01486fdb-6e51-40b8-abf8-c8ba0fe14502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502', 'volume_size': 1} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1300192082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01486fdb-6e51-40b8-abf8-c8ba0fe14502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650efe30f4aa4d20b6b7e5b3b57dd06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:51Z,use_quota=True,user_id='845bbbdab1714677b3f49a1a0b8d06a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Creating volume 01486fdb-6e51-40b8-abf8-c8ba0fe14502 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:51 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164" returned: 0 in 1.465s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:15:51 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 1073741824 Jun 25 18:15:51 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a33557-34ea-4c88-b346-d6d17f6a7b7b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:51 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 Jun 25 18:15:51 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Acquiring lock "cinder-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Lock "cinder-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Acquiring lock "cinder-quobyte-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Lock "cinder-quobyte-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:52 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e878dafe-7577-4317-812a-45e644ec2088]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:52 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 Jun 25 18:15:52 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:53 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" returned: 0 in 1.214s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:53 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 Jun 25 18:15:53 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:53 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 1073741824" returned: 0 in 1.456s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:53 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 Jun 25 18:15:53 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:53 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45" returned: 0 in 1.136s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:53 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45 Jun 25 18:15:53 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:53 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164" returned: 0 in 0.916s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:53 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164 Jun 25 18:15:53 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:54 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502" returned: 0 in 0.823s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3459c3-72f7-4603-8bc9-126ef200b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110818a0-d9af-42c3-9638-42d315a654d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:54 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Volume volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 (01486fdb-6e51-40b8-abf8-c8ba0fe14502): created successfully Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110818a0-d9af-42c3-9638-42d315a654d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Flow 'volume_create_manager' (04c55d26-42ea-44ed-8339-6af4bbd771eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:54 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-3e52f40e-13de-49de-b347-dc042b2a1104 tempest-AttachVolumeShelveTestJSON-1431210834 None] Created volume successfully. Jun 25 18:15:54 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45" returned: 0 in 0.840s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Lock "cinder-quobyte-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45" released by "delete_volume" :: held 2.056s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Created reservations ['b0003c4c-2341-4f36-bb8a-525b29579d44', '60419755-90ec-4563-b2bd-b84925e2335e', '3373291f-19a8-49e1-8d37-d78a15c59101', '7060c75e-c123-43f0-8099-7b06a4611984'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:54 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3.c1cf802b-1ab0-44f7-87ab-f0232f191164" returned: 0 in 0.746s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:54 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:15:54 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-c1cf802b-1ab0-44f7-87ab-f0232f191164" released by "_delete_snapshot" :: held 4.494s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" released by "delete_snapshot" :: held 4.538s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Created reservations ['1e9c1628-c57c-4fc3-a4f3-b0dffc6a59df', '7a6247ae-da57-41bd-ac64-1374a2e089ab', 'f2fc4f49-6a1f-40e9-a0b0-6f5d7ff6dc5e', '6962b466-7a3f-4c54-89ae-e39122881b64'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:54 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Delete snapshot completed successfully. Jun 25 18:15:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01a32ee1-9d68-4366-86d8-1dc5641cf4c1 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-c1cf802b-1ab0-44f7-87ab-f0232f191164-delete_snapshot" released by "delete_snapshot" :: held 4.847s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:55 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.734s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:55 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:55 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Deleted volume successfully. Jun 25 18:15:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8aa170bb-d532-4117-b9ae-6fedfd11692d tempest-VolumesTransfersTest-385886352 None] Lock "cinder-d1c3a7d2-f6be-41bb-a524-aa27f6d30e45-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (93c0e820-4b47-46a8-aab9-3dd014cda020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9434e09f-7f0f-444f-b88b-d9a869b6600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9434e09f-7f0f-444f-b88b-d9a869b6600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1343970014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab91ceffd4f04041be3d9257295ed2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:56Z,use_quota=True,user_id='41dfdf98c6bf4acaa23b8af9772d9b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c4a9a1-ed55-42ac-8856-cbb6f7717cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c4a9a1-ed55-42ac-8856-cbb6f7717cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec72133-646b-4d45-ab41-f988001dee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec72133-646b-4d45-ab41-f988001dee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3', 'volume_name': 'volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c1ae6f-a7a1-4d2d-9ec2-95c937d59e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c1ae6f-a7a1-4d2d-9ec2-95c937d59e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b225356-4bc1-4ea2-aa91-9471c1c34069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:56 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Volume 770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3', 'volume_size': 1} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1343970014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab91ceffd4f04041be3d9257295ed2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:56Z,use_quota=True,user_id='41dfdf98c6bf4acaa23b8af9772d9b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Creating volume 770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:56 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:15:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:56 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 1073741824 Jun 25 18:15:56 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:57 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 1073741824" returned: 0 in 1.045s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:57 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 Jun 25 18:15:57 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:58 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" returned: 0 in 1.152s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b225356-4bc1-4ea2-aa91-9471c1c34069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d31694-5eaf-420e-a5f8-ec3cf2d2b08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:58 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Volume volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 (770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3): created successfully Jun 25 18:15:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d31694-5eaf-420e-a5f8-ec3cf2d2b08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (93c0e820-4b47-46a8-aab9-3dd014cda020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:58 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6c764fd1-be33-40be-a577-b4c9d50c338f tempest-VolumesSnapshotTestJSON-685795700 None] Created volume successfully. Jun 25 18:16:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Creating offline snapshot 22bad172-e08e-4a28-8540-df691ea8ab33 of volume 770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:16:00 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1511d2c0-cc06-4cb6-9ff4-4d8973e23cf5]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:00 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 Jun 25 18:16:00 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:01 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" returned: 0 in 1.323s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:01 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 1G Jun 25 18:16:01 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:03 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 1G" returned: 0 in 1.816s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:03 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 Jun 25 18:16:03 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:04 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33" returned: 0 in 1.274s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:04 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 is being set with open permissions: ugo+rw Jun 25 18:16:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:04 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 Jun 25 18:16:04 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:05 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33" returned: 0 in 1.249s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:05 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.info Jun 25 18:16:05 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:06 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.info" returned: 0 in 0.814s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:06 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.info is being set with open permissions: ugo+rw Jun 25 18:16:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:06 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.info Jun 25 18:16:06 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:07 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.info" returned: 0 in 1.125s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.796s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:07 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b03040e8-4507-4904-8db1-a5da1845757e tempest-VolumesSnapshotTestJSON-685795700 None] Create snapshot completed successfully Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Flow 'volume_create_manager' (f38f11ef-c638-4930-bdf3-bdbca603a102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89904a6e-078d-4763-9ef7-b5326b086620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89904a6e-078d-4763-9ef7-b5326b086620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1132344610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360f17cc-c1fc-47e4-9133-34760384128e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a71ab443444d2b6c8178d698b7cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:08Z,use_quota=True,user_id='47160bb6227e4c4da38c8fa67d030036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa08b629-68c2-47b6-a87a-1511032c4657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa08b629-68c2-47b6-a87a-1511032c4657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c474e5c9-8b28-42e6-aa8f-c54089ba249b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c474e5c9-8b28-42e6-aa8f-c54089ba249b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360f17cc-c1fc-47e4-9133-34760384128e', 'volume_name': 'volume-360f17cc-c1fc-47e4-9133-34760384128e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7072e29-762c-489e-9e21-46abd9e659ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7072e29-762c-489e-9e21-46abd9e659ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ab640c-ac9a-4973-956a-92f2ada13daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:08 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Volume 360f17cc-c1fc-47e4-9133-34760384128e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360f17cc-c1fc-47e4-9133-34760384128e', 'volume_size': 1} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1132344610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360f17cc-c1fc-47e4-9133-34760384128e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a71ab443444d2b6c8178d698b7cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:08Z,use_quota=True,user_id='47160bb6227e4c4da38c8fa67d030036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Creating volume 360f17cc-c1fc-47e4-9133-34760384128e {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:08 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:16:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:08 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e 1073741824 Jun 25 18:16:08 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (bf84c70f-9d47-46ec-9df9-46c42811a11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006f8425-8ee0-4918-96ed-cb2a381996f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006f8425-8ee0-4918-96ed-cb2a381996f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1896783906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4978a1-99b7-4993-8800-4d4bfced7e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab91ceffd4f04041be3d9257295ed2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=22bad172-e08e-4a28-8540-df691ea8ab33,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:09Z,use_quota=True,user_id='41dfdf98c6bf4acaa23b8af9772d9b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338c9c0d-a195-4e4c-a16e-6e625046bc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338c9c0d-a195-4e4c-a16e-6e625046bc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81219afd-4f58-408e-a5bf-22c2d3b17ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81219afd-4f58-408e-a5bf-22c2d3b17ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca4978a1-99b7-4993-8800-4d4bfced7e6d', 'volume_name': 'volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d', 'volume_size': 2, 'snapshot_id': '22bad172-e08e-4a28-8540-df691ea8ab33'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596598ce-ae3f-424a-82ac-3721bcf913dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596598ce-ae3f-424a-82ac-3721bcf913dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edbddfd-47b9-437e-b31d-0ad4c2f1517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:09 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Volume ca4978a1-99b7-4993-8800-4d4bfced7e6d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d', 'volume_size': 2, 'snapshot_id': '22bad172-e08e-4a28-8540-df691ea8ab33'} Jun 25 18:16:09 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e 1073741824" returned: 0 in 1.177s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:09 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e Jun 25 18:16:09 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:10 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e" returned: 0 in 0.757s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.808s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-22bad172-e08e-4a28-8540-df691ea8ab33-ca4978a1-99b7-4993-8800-4d4bfced7e6d" by "_create_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ab640c-ac9a-4973-956a-92f2ada13daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360f17cc-c1fc-47e4-9133-34760384128e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828ebddd-42fd-4e1d-aca6-b22e07843b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:10 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Volume volume-360f17cc-c1fc-47e4-9133-34760384128e (360f17cc-c1fc-47e4-9133-34760384128e): created successfully Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828ebddd-42fd-4e1d-aca6-b22e07843b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Flow 'volume_create_manager' (f38f11ef-c638-4930-bdf3-bdbca603a102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-22bad172-e08e-4a28-8540-df691ea8ab33-ca4978a1-99b7-4993-8800-4d4bfced7e6d" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Creating volume ca4978a1-99b7-4993-8800-4d4bfced7e6d from snapshot 22bad172-e08e-4a28-8540-df691ea8ab33 {{(pid=93767) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-ca4978a1-99b7-4993-8800-4d4bfced7e6d" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9bb19b49-a6c7-42ff-84b6-d00f53461f1a tempest-VolumesTransfersV357Test-1833799804 None] Created volume successfully. Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-ca4978a1-99b7-4993-8800-4d4bfced7e6d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] snapshot: 22bad172-e08e-4a28-8540-df691ea8ab33, volume: ca4978a1-99b7-4993-8800-4d4bfced7e6d, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96e6359-7cd1-48d2-bb13-593d3e4db0b3]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:10 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 Jun 25 18:16:10 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:11 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33" returned: 0 in 1.146s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:16:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:16:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:16:11 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3b1a22-f8b6-463b-b93a-d01519809c15]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:11 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 Jun 25 18:16:11 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:12 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-49353225-c324-4d69-9e06-2e3bdd8ac8ce tempest-VolumesTransfersV357Test-526627929 None] Transfer volume completed successfully. Jun 25 18:16:12 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" returned: 0 in 1.035s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:12 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:16:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:12 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d Jun 25 18:16:12 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Acquiring lock "cinder-360f17cc-c1fc-47e4-9133-34760384128e-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Lock "cinder-360f17cc-c1fc-47e4-9133-34760384128e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Acquiring lock "cinder-quobyte-360f17cc-c1fc-47e4-9133-34760384128e" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Lock "cinder-quobyte-360f17cc-c1fc-47e4-9133-34760384128e" acquired by "delete_volume" :: waited 0.024s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:13 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bc79e2-3d65-4ec6-9f69-e803906b9f13]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:13 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e Jun 25 18:16:13 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:15 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e" returned: 0 in 1.837s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:15 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e Jun 25 18:16:15 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7a37c0bd-fcaa-4a26-b5d3-802e33de0b8c req-92c99e53-2884-4c85-8752-7d0bb733d87b tempest-AttachVolumeShelveTestJSON-1431210834 None] No connector for attachment 4276043f-5864-412a-a058-4498da509f8f; skipping storage backend terminate_connection call. {{(pid=93767) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5642}} Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7a37c0bd-fcaa-4a26-b5d3-802e33de0b8c req-92c99e53-2884-4c85-8752-7d0bb733d87b tempest-AttachVolumeShelveTestJSON-1431210834 None] Deleting attachment 4276043f-5864-412a-a058-4498da509f8f. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:16:17 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-360f17cc-c1fc-47e4-9133-34760384128e" returned: 0 in 1.444s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Lock "cinder-quobyte-360f17cc-c1fc-47e4-9133-34760384128e" released by "delete_volume" :: held 3.340s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Created reservations ['bccd1294-3b44-48b7-8dfa-08fb759fbd2f', '4360bfc1-18f0-4d7e-92e0-4b4ddaf1e323', 'b0e54487-3329-4842-a444-c4947256fda6', '3fd5c9d1-ffe8-4bf3-845b-8f344eca41ee'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:17 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:16:17 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:19 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 2.058s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:19 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Deleted volume successfully. Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-38b46287-ca50-4a28-ba78-65a483b75e0c tempest-VolumesTransfersV357Test-1510603005 None] Lock "cinder-360f17cc-c1fc-47e4-9133-34760384128e-delete_volume" released by "delete_volume" :: held 5.985s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:19 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d" returned: 0 in 6.962s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d312f2-9280-4ce0-b650-aa5776b6b865]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Flow 'volume_create_manager' (a68ad215-9e90-43d6-9472-505641159d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94095caa-ebdb-4d23-b2b9-60077807f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94095caa-ebdb-4d23-b2b9-60077807f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1530912117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f9a299-a5dd-4871-bf3b-911197f43805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a71ab443444d2b6c8178d698b7cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:20Z,use_quota=True,user_id='47160bb6227e4c4da38c8fa67d030036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc1e3bc-35f2-49f6-9644-a847958ff0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc1e3bc-35f2-49f6-9644-a847958ff0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7e326a-f396-4f27-a804-92d3e0d32151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7e326a-f396-4f27-a804-92d3e0d32151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f9a299-a5dd-4871-bf3b-911197f43805', 'volume_name': 'volume-e5f9a299-a5dd-4871-bf3b-911197f43805', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:19 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 Jun 25 18:16:19 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14918dce-8e2a-4a82-8812-a1e0c18eb272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14918dce-8e2a-4a82-8812-a1e0c18eb272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e326ff21-2869-4f79-942b-b31ed75ab61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:19 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Volume e5f9a299-a5dd-4871-bf3b-911197f43805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f9a299-a5dd-4871-bf3b-911197f43805', 'volume_size': 1} Jun 25 18:16:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:20 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" returned: 0 in 1.092s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:20 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:16:20 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Converted 1024.00 MB image at 147.07 MB/s Jun 25 18:16:20 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d is being set with open permissions: ugo+rw Jun 25 18:16:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:20 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d Jun 25 18:16:20 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:21 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d" returned: 0 in 0.765s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-ca4978a1-99b7-4993-8800-4d4bfced7e6d" released by "_copy_volume_from_snapshot" :: held 11.161s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-22bad172-e08e-4a28-8540-df691ea8ab33-ca4978a1-99b7-4993-8800-4d4bfced7e6d" released by "_create_volume_from_snapshot" :: held 11.205s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.254s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1530912117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f9a299-a5dd-4871-bf3b-911197f43805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a71ab443444d2b6c8178d698b7cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:20Z,use_quota=True,user_id='47160bb6227e4c4da38c8fa67d030036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Creating volume e5f9a299-a5dd-4871-bf3b-911197f43805 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:21 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:21 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805 1073741824 Jun 25 18:16:21 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edbddfd-47b9-437e-b31d-0ad4c2f1517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d', 'volume_size': 2, 'snapshot_id': '22bad172-e08e-4a28-8540-df691ea8ab33'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdc028b-ba86-4c5a-a9a0-b24f06632eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:21 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Volume volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d (ca4978a1-99b7-4993-8800-4d4bfced7e6d): created successfully Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdc028b-ba86-4c5a-a9a0-b24f06632eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (bf84c70f-9d47-46ec-9df9-46c42811a11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:21 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-153b1484-bf7f-470a-8796-3338763473d5 tempest-VolumesSnapshotTestJSON-685795700 None] Created volume successfully. Jun 25 18:16:22 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805 1073741824" returned: 0 in 1.030s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:22 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805 Jun 25 18:16:22 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-ca4978a1-99b7-4993-8800-4d4bfced7e6d-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-ca4978a1-99b7-4993-8800-4d4bfced7e6d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-ca4978a1-99b7-4993-8800-4d4bfced7e6d" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-ca4978a1-99b7-4993-8800-4d4bfced7e6d" acquired by "delete_volume" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd7c5b-b3f2-4c2b-b8b5-1cf4f8e3f7bd]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:23 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d Jun 25 18:16:23 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:23 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805" returned: 0 in 0.753s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e326ff21-2869-4f79-942b-b31ed75ab61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f9a299-a5dd-4871-bf3b-911197f43805', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4133dad-8332-4510-ab55-f2662e097d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:23 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Volume volume-e5f9a299-a5dd-4871-bf3b-911197f43805 (e5f9a299-a5dd-4871-bf3b-911197f43805): created successfully Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4133dad-8332-4510-ab55-f2662e097d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:23 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Flow 'volume_create_manager' (a68ad215-9e90-43d6-9472-505641159d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-09ee6f45-e39c-45ad-8133-6025c1514a7b tempest-VolumesTransfersV357Test-1833799804 None] Created volume successfully. Jun 25 18:16:24 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d" returned: 0 in 0.897s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:24 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d Jun 25 18:16:24 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Acquiring lock "cinder-e5f9a299-a5dd-4871-bf3b-911197f43805-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Lock "cinder-e5f9a299-a5dd-4871-bf3b-911197f43805-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Acquiring lock "cinder-quobyte-e5f9a299-a5dd-4871-bf3b-911197f43805" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Lock "cinder-quobyte-e5f9a299-a5dd-4871-bf3b-911197f43805" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cd9977-fd11-4b8c-98ae-6426d6845315]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:24 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ca4978a1-99b7-4993-8800-4d4bfced7e6d" returned: 0 in 0.764s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-ca4978a1-99b7-4993-8800-4d4bfced7e6d" released by "delete_volume" :: held 1.719s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:24 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805 Jun 25 18:16:24 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Created reservations ['a0074b69-5f44-4d02-85a6-fda891296b8a', '99f0fded-d2d2-4159-a3b4-75806fd1ef3e', '67393b9b-7d44-4669-907e-46c448e2b7a6', '332b8553-b09e-4a38-b7e4-918a405706d6'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:24 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:16:24 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-22bad172-e08e-4a28-8540-df691ea8ab33-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-22bad172-e08e-4a28-8540-df691ea8ab33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-22bad172-e08e-4a28-8540-df691ea8ab33" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-22bad172-e08e-4a28-8540-df691ea8ab33" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Deleting offline snapshot 22bad172-e08e-4a28-8540-df691ea8ab33 of volume 770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] snapshot_file for this snap is: volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[fded7002-543c-4e66-92b5-0c9dbfca721f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:25 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 Jun 25 18:16:25 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:25 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805" returned: 0 in 1.003s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:25 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805 Jun 25 18:16:25 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:25 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.845s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:25 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Deleted volume successfully. Jun 25 18:16:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-612399b4-72d3-4164-a16f-4009f99b7f57 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-ca4978a1-99b7-4993-8800-4d4bfced7e6d-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Flow 'volume_create_manager' (4af1786f-de11-417c-93e3-03bb1104c915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eeaeb0-ec86-434a-adc4-fe904ca8f440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:26 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eeaeb0-ec86-434a-adc4-fe904ca8f440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1857106748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c3b6a5-5884-4dae-9df7-515a3957c7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ab74d92214502bf8a96c47a2d2c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:26Z,use_quota=True,user_id='410cbc4fbc7045cfbdb651bd9412afe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b439a7-b69c-468b-9fec-472f4ae69b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b439a7-b69c-468b-9fec-472f4ae69b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f038b2-720a-47e8-b60b-d0acfe06494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f038b2-720a-47e8-b60b-d0acfe06494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c3b6a5-5884-4dae-9df7-515a3957c7a6', 'volume_name': 'volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:26 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44e12fb-1304-4e46-b351-4111b95980c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44e12fb-1304-4e46-b351-4111b95980c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca10818-8962-4dc7-9a22-274f6b3bf9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:26 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Volume d1c3b6a5-5884-4dae-9df7-515a3957c7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6', 'volume_size': 1} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1857106748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c3b6a5-5884-4dae-9df7-515a3957c7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ab74d92214502bf8a96c47a2d2c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:26Z,use_quota=True,user_id='410cbc4fbc7045cfbdb651bd9412afe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Creating volume d1c3b6a5-5884-4dae-9df7-515a3957c7a6 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:26 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33" returned: 0 in 1.147s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e5f9a299-a5dd-4871-bf3b-911197f43805" returned: 0 in 0.949s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:16:26 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 1073741824 Jun 25 18:16:26 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Lock "cinder-quobyte-e5f9a299-a5dd-4871-bf3b-911197f43805" released by "delete_volume" :: held 2.030s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38a7fa5-96be-4c6f-b0ab-19537d178698]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Created reservations ['d97df0cd-3eb6-4666-874f-e98a5049068f', '72c3c141-abe8-464e-951f-953060613f9f', 'f903b0b1-6002-4137-8dbf-c5c070c29fa7', '69c4f0dd-88bc-4d38-a34a-c6fbc141ce1f'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:26 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 Jun 25 18:16:26 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:26 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:16:26 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:28 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.143s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:28 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:28 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Deleted volume successfully. Jun 25 18:16:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0bcb0f70-f137-4dff-90f9-553746b78279 tempest-VolumesTransfersV357Test-1510603005 None] Lock "cinder-e5f9a299-a5dd-4871-bf3b-911197f43805-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:28 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 1073741824" returned: 0 in 1.624s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:28 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" returned: 0 in 1.596s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:28 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 Jun 25 18:16:28 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:28 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 Jun 25 18:16:28 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:29 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6" returned: 0 in 0.885s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] <== create_volume: return (2570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.574s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca10818-8962-4dc7-9a22-274f6b3bf9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede14b22-b831-4f09-9923-dde0a8e7f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:29 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33" returned: 0 in 0.953s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:29 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Volume volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 (d1c3b6a5-5884-4dae-9df7-515a3957c7a6): created successfully Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede14b22-b831-4f09-9923-dde0a8e7f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Flow 'volume_create_manager' (4af1786f-de11-417c-93e3-03bb1104c915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:29 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33 Jun 25 18:16:29 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-af497068-9f25-41e5-9c63-b296c17a7e94 tempest-AttachVolumeNegativeTest-1899965128 None] Created volume successfully. Jun 25 18:16:29 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3.22bad172-e08e-4a28-8540-df691ea8ab33" returned: 0 in 0.791s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-22bad172-e08e-4a28-8540-df691ea8ab33" released by "_delete_snapshot" :: held 4.627s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" released by "delete_snapshot" :: held 4.653s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:30 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Created reservations ['9b54515d-d3f2-4db2-8737-084f7237c7d1', '6956f091-3ab7-4532-80ab-6404d92a2a55', 'f92cbd9e-ea25-4fc8-a8b6-5dc72c345cb5', 'acc01b95-92ba-4aca-b4b1-be038d066dc2'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:30 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Delete snapshot completed successfully. Jun 25 18:16:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5c016ecc-49af-4b2f-810a-e6b8936aef12 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-22bad172-e08e-4a28-8540-df691ea8ab33-delete_snapshot" released by "delete_snapshot" :: held 4.860s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[acafafbd-bfd6-460a-aacd-e2dd3961f84d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:31 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 Jun 25 18:16:31 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:32 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" returned: 0 in 1.401s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:32 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3 Jun 25 18:16:32 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:33 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" returned: 0 in 0.815s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3" released by "delete_volume" :: held 2.322s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Created reservations ['395ef8d0-1534-45fd-b08b-3a6f462872e8', '74b48b35-cbb0-4a13-937b-a8a75b7cfdbb', 'c9542f60-fd9d-4127-bf84-21ff570ce4a4', '746897e6-5870-461e-bd33-6cf868e5fc43'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:33 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:16:33 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=65,cinder:INSERT=24,cinder:UPDATE=87,cinder:DELETE=6 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-8f479b39-a206-4fce-a319-c54a3ab65836 req-62918f0f-f5fb-4cac-8ce8-9106defda5f4 tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-8f479b39-a206-4fce-a319-c54a3ab65836 req-62918f0f-f5fb-4cac-8ce8-9106defda5f4 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ca9f1e-0409-46f8-af4d-beb5e586c3bc]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-8f479b39-a206-4fce-a319-c54a3ab65836 req-62918f0f-f5fb-4cac-8ce8-9106defda5f4 tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:34 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 Jun 25 18:16:34 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:34 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.856s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:34 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:34 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Deleted volume successfully. Jun 25 18:16:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ffbf46ce-2918-451d-a426-74a9a93f6b8a tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-770e9b60-d0c3-43e4-945f-b7bf0cb5f2b3-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:34 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-8f479b39-a206-4fce-a319-c54a3ab65836 req-62918f0f-f5fb-4cac-8ce8-9106defda5f4 tempest-AttachVolumeNegativeTest-1899965128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6" returned: 0 in 1.059s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-8f479b39-a206-4fce-a319-c54a3ab65836 req-62918f0f-f5fb-4cac-8ce8-9106defda5f4 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.083s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=91,cinder:SELECT=88,cinder:INSERT=18,cinder:DELETE=10 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Flow 'volume_create_manager' (39656cc1-19b4-4981-ab56-5f68ff683b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b686c5-8d34-4ad9-91f1-bb085dfee79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-8f479b39-a206-4fce-a319-c54a3ab65836 req-62918f0f-f5fb-4cac-8ce8-9106defda5f4 tempest-AttachVolumeNegativeTest-1899965128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '472b14b3-5525-4f19-bcaa-0e9f69d1175d', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b686c5-8d34-4ad9-91f1-bb085dfee79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1046385559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20ac6d4-e1c1-487d-88c6-ac3c764f8595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bbab0eddc694224b59d0b1db206e52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:35Z,use_quota=True,user_id='293d360759df4ca2ad0abc53e2bc0a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5328629f-1fe8-4305-9c16-6b3d12195aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5328629f-1fe8-4305-9c16-6b3d12195aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209bba38-1bd3-4bab-8daa-5471c090cbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209bba38-1bd3-4bab-8daa-5471c090cbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20ac6d4-e1c1-487d-88c6-ac3c764f8595', 'volume_name': 'volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e8b550-a4c3-434c-8e5f-6fb794edd21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e8b550-a4c3-434c-8e5f-6fb794edd21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c4d075-be8c-437a-b54e-b05b1886f4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:35 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Volume b20ac6d4-e1c1-487d-88c6-ac3c764f8595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595', 'volume_size': 1} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1046385559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20ac6d4-e1c1-487d-88c6-ac3c764f8595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bbab0eddc694224b59d0b1db206e52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:35Z,use_quota=True,user_id='293d360759df4ca2ad0abc53e2bc0a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Creating volume b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:35 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:16:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:35 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 1073741824 Jun 25 18:16:35 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-8f479b39-a206-4fce-a319-c54a3ab65836 req-62918f0f-f5fb-4cac-8ce8-9106defda5f4 tempest-AttachVolumeNegativeTest-1899965128 None] attachment_update completed successfully. Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (a137b82d-5374-4f51-bca4-ec1df7aa08fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6332d0-e93a-46f1-84d6-2dc962c32efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6332d0-e93a-46f1-84d6-2dc962c32efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2070432085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86809da6-1b50-421d-95f6-4f02e8e5d674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab91ceffd4f04041be3d9257295ed2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:36Z,use_quota=True,user_id='41dfdf98c6bf4acaa23b8af9772d9b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c121bf-b731-46bd-a48c-64c3f30d9919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c121bf-b731-46bd-a48c-64c3f30d9919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64ecf41-12e6-4498-868b-2cdd8c354979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64ecf41-12e6-4498-868b-2cdd8c354979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86809da6-1b50-421d-95f6-4f02e8e5d674', 'volume_name': 'volume-86809da6-1b50-421d-95f6-4f02e8e5d674', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a69cd2-a69d-48f6-9d2f-0f03a06e4882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a69cd2-a69d-48f6-9d2f-0f03a06e4882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac763d4-0054-4115-9284-c85efb9de480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:36 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Volume 86809da6-1b50-421d-95f6-4f02e8e5d674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86809da6-1b50-421d-95f6-4f02e8e5d674', 'volume_size': 1} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:36 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 1073741824" returned: 0 in 1.477s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:36 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 Jun 25 18:16:36 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:37 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" returned: 0 in 0.675s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2070432085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86809da6-1b50-421d-95f6-4f02e8e5d674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab91ceffd4f04041be3d9257295ed2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:36Z,use_quota=True,user_id='41dfdf98c6bf4acaa23b8af9772d9b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Creating volume 86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:37 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c4d075-be8c-437a-b54e-b05b1886f4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:37 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 1073741824 Jun 25 18:16:37 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395b8744-d4a7-4b1f-ae71-d51a965eb3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:37 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Volume volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 (b20ac6d4-e1c1-487d-88c6-ac3c764f8595): created successfully Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395b8744-d4a7-4b1f-ae71-d51a965eb3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Flow 'volume_create_manager' (39656cc1-19b4-4981-ab56-5f68ff683b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b00f2dc2-ce52-4fa5-9539-e6be086793bd tempest-VolumesSnapshotListTestJSON-1525991737 None] Created volume successfully. Jun 25 18:16:38 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 1073741824" returned: 0 in 1.001s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:38 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 Jun 25 18:16:38 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:39 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674" returned: 0 in 0.827s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.821s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Creating offline snapshot d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 of volume b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac763d4-0054-4115-9284-c85efb9de480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86809da6-1b50-421d-95f6-4f02e8e5d674', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e25ac3-3a7a-4147-8eae-070d39697fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e472d36-54d0-4409-9eb4-d4f96feb0d49]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Volume volume-86809da6-1b50-421d-95f6-4f02e8e5d674 (86809da6-1b50-421d-95f6-4f02e8e5d674): created successfully Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e25ac3-3a7a-4147-8eae-070d39697fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (a137b82d-5374-4f51-bca4-ec1df7aa08fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-bb57007c-f022-4514-8606-a36a3f4ec69e tempest-VolumesSnapshotTestJSON-685795700 None] Created volume successfully. Jun 25 18:16:39 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 Jun 25 18:16:39 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:40 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:16:40 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:40 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" returned: 0 in 1.359s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:40 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 1G Jun 25 18:16:40 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:42 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.532s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:42 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:42 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:16:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:16:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:16:42 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 1G" returned: 0 in 1.643s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:42 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 Jun 25 18:16:42 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:43 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" returned: 0 in 1.037s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:43 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 is being set with open permissions: ugo+rw Jun 25 18:16:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:43 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 Jun 25 18:16:43 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:44 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" returned: 0 in 0.905s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:44 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.info Jun 25 18:16:44 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-98fcb608-334c-4f2a-817d-dc44f21971b4 req-60ef46e7-8989-4a50-964c-5d84ca86ef94 tempest-AttachVolumeNegativeTest-1899965128 None] Terminate volume connection completed successfully. Jun 25 18:16:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-98fcb608-334c-4f2a-817d-dc44f21971b4 req-60ef46e7-8989-4a50-964c-5d84ca86ef94 tempest-AttachVolumeNegativeTest-1899965128 None] Deleting attachment 472b14b3-5525-4f19-bcaa-0e9f69d1175d. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:16:45 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.info" returned: 0 in 0.965s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:45 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.info is being set with open permissions: ugo+rw Jun 25 18:16:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:45 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.info Jun 25 18:16:45 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:46 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.info" returned: 0 in 0.769s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.822s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.412s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Creating offline snapshot ffcc6a9e-e3c3-4fba-8a48-5401458581ce of volume 86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:16:46 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-656ed9d8-c786-4eb6-b7db-a2d54ac18cc2 tempest-VolumesSnapshotListTestJSON-1525991737 None] Create snapshot completed successfully Jun 25 18:16:46 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b950c01-f030-4196-b708-a7397279e8b2]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:46 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 Jun 25 18:16:46 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:47 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674" returned: 0 in 1.131s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:47 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce 1G Jun 25 18:16:47 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:48 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce 1G" returned: 0 in 1.357s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86809da6-1b50-421d-95f6-4f02e8e5d674 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:48 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86809da6-1b50-421d-95f6-4f02e8e5d674 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce Jun 25 18:16:48 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:49 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86809da6-1b50-421d-95f6-4f02e8e5d674 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce" returned: 0 in 0.781s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:49 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce is being set with open permissions: ugo+rw Jun 25 18:16:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:49 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce Jun 25 18:16:49 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:50 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce" returned: 0 in 0.870s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:50 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.info Jun 25 18:16:50 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:51 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.info" returned: 0 in 0.717s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:51 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.info is being set with open permissions: ugo+rw Jun 25 18:16:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:51 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.info Jun 25 18:16:51 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:51 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.info" returned: 0 in 0.671s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.708s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.468s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Creating offline snapshot 826c21b4-b4b0-4e84-8308-ee0fa63ba95e of volume b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:16:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-69478ac8-0b61-4291-bee7-ae9b20b729cb tempest-VolumesSnapshotTestJSON-685795700 None] Create snapshot completed successfully Jun 25 18:16:51 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa33cecf-1091-4e40-ae3e-c356f1eb1534]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:52 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 Jun 25 18:16:52 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:52 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" returned: 0 in 0.838s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:16:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:52 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e 1G Jun 25 18:16:52 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (80aad7d7-bcf3-4534-a9a2-4bcfbdd58a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f244683-5d30-48a3-808f-57f0f5cba4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f244683-5d30-48a3-808f-57f0f5cba4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-306218342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936b45c4-23b0-4637-a9eb-f12ab0fa201e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab91ceffd4f04041be3d9257295ed2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ffcc6a9e-e3c3-4fba-8a48-5401458581ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:53Z,use_quota=True,user_id='41dfdf98c6bf4acaa23b8af9772d9b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6470b2a6-fb39-4fd6-b426-df28a8eba4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6470b2a6-fb39-4fd6-b426-df28a8eba4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089c7fd9-06b7-4ee5-82d1-c56e01084991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089c7fd9-06b7-4ee5-82d1-c56e01084991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '936b45c4-23b0-4637-a9eb-f12ab0fa201e', 'volume_name': 'volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e', 'volume_size': 1, 'snapshot_id': 'ffcc6a9e-e3c3-4fba-8a48-5401458581ce'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21060151-c30b-442f-bd87-32124794e4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21060151-c30b-442f-bd87-32124794e4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47131dd9-0827-49f0-b403-db2adf777e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:53 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Volume 936b45c4-23b0-4637-a9eb-f12ab0fa201e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e', 'volume_size': 1, 'snapshot_id': 'ffcc6a9e-e3c3-4fba-8a48-5401458581ce'} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:53 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e 1G" returned: 0 in 1.108s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:53 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e Jun 25 18:16:53 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:54 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e" returned: 0 in 0.830s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:54 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e is being set with open permissions: ugo+rw Jun 25 18:16:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:54 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e Jun 25 18:16:54 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:55 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e" returned: 0 in 0.754s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.667s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.348s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-ffcc6a9e-e3c3-4fba-8a48-5401458581ce-936b45c4-23b0-4637-a9eb-f12ab0fa201e" by "_create_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-ffcc6a9e-e3c3-4fba-8a48-5401458581ce-936b45c4-23b0-4637-a9eb-f12ab0fa201e" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Creating volume 936b45c4-23b0-4637-a9eb-f12ab0fa201e from snapshot ffcc6a9e-e3c3-4fba-8a48-5401458581ce {{(pid=93767) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-936b45c4-23b0-4637-a9eb-f12ab0fa201e" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:55 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-21f97369-e74e-4b67-8d9f-248bff0e44f5 tempest-VolumesSnapshotListTestJSON-1525991737 None] Create snapshot completed successfully Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-936b45c4-23b0-4637-a9eb-f12ab0fa201e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] snapshot: ffcc6a9e-e3c3-4fba-8a48-5401458581ce, volume: 936b45c4-23b0-4637-a9eb-f12ab0fa201e, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "cinder-d1c3b6a5-5884-4dae-9df7-515a3957c7a6-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b02970-5846-4010-bdf8-72d27c37f026]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-d1c3b6a5-5884-4dae-9df7-515a3957c7a6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "cinder-quobyte-d1c3b6a5-5884-4dae-9df7-515a3957c7a6" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-quobyte-d1c3b6a5-5884-4dae-9df7-515a3957c7a6" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3122eee-6123-4a34-ab28-cab68f704937]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:55 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce Jun 25 18:16:55 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:55 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 Jun 25 18:16:55 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:56 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce" returned: 0 in 0.886s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86809da6-1b50-421d-95f6-4f02e8e5d674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:16:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:16:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:16:56 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1fa4f6-9630-4d76-bcaa-fd13ef8aabfe]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:56 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6" returned: 0 in 0.816s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:56 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6 Jun 25 18:16:56 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:56 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 Jun 25 18:16:56 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:57 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1c3b6a5-5884-4dae-9df7-515a3957c7a6" returned: 0 in 0.738s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-quobyte-d1c3b6a5-5884-4dae-9df7-515a3957c7a6" released by "delete_volume" :: held 1.604s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Created reservations ['4f4c534b-48cf-4a36-b131-de904f036894', 'e48ff309-5e98-43aa-a94a-d5568dc45351', 'a29be6e1-c135-42a1-8175-a31fcebc686b', '5b4dc7a0-f3e2-4ce1-8cf9-239cab2953b4'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:57 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674" returned: 0 in 0.969s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:57 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e Jun 25 18:16:57 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:57 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:16:57 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "cinder-eb08ee8e-ed56-46a3-82b4-fad933a80644-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-eb08ee8e-ed56-46a3-82b4-fad933a80644-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "cinder-quobyte-eb08ee8e-ed56-46a3-82b4-fad933a80644" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-quobyte-eb08ee8e-ed56-46a3-82b4-fad933a80644" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:58 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bfe13b-071c-4c81-8f08-b4cbb2db4052]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:58 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 Jun 25 18:16:58 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:58 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.905s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:58 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:58 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Deleted volume successfully. Jun 25 18:16:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e32cbcb-c389-41fc-9d7e-cfc738287302 tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-d1c3b6a5-5884-4dae-9df7-515a3957c7a6-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:59 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644" returned: 0 in 1.665s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:59 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644 Jun 25 18:16:59 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:01 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-eb08ee8e-ed56-46a3-82b4-fad933a80644" returned: 0 in 1.488s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:01 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-quobyte-eb08ee8e-ed56-46a3-82b4-fad933a80644" released by "delete_volume" :: held 3.238s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:01 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Created reservations ['0c986ffb-d59e-44d6-8512-4febf3ceb4d8', '50c69016-636d-455d-8da5-a79482ec88f0', '8c25f4e6-c838-4db5-83f3-6131c54eb87b', '6d89862d-9348-4cdd-acca-c535d4ba55f8'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:01 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:17:01 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.223s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:02 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:02 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Deleted volume successfully. Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-86b3df97-9f7a-4e4b-92e6-a4ac17450c1b tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-eb08ee8e-ed56-46a3-82b4-fad933a80644-delete_volume" released by "delete_volume" :: held 4.919s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:03 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e" returned: 0 in 5.653s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "cinder-8b30b1d0-7288-4756-9fff-7f1001b9fb75-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cf5967-876a-4693-b0c0-6b8d988bd06d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-8b30b1d0-7288-4756-9fff-7f1001b9fb75-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "cinder-quobyte-8b30b1d0-7288-4756-9fff-7f1001b9fb75" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-quobyte-8b30b1d0-7288-4756-9fff-7f1001b9fb75" acquired by "delete_volume" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:03 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 Jun 25 18:17:03 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a68f7e-96fd-4850-8321-700246c41466]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:03 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 Jun 25 18:17:03 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:04 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75" returned: 0 in 0.882s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:04 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674" returned: 0 in 1.032s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:04 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:17:04 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Converted 1024.00 MB image at 181.11 MB/s Jun 25 18:17:04 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e is being set with open permissions: ugo+rw Jun 25 18:17:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:04 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75 Jun 25 18:17:04 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:04 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e Jun 25 18:17:04 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:04 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8b30b1d0-7288-4756-9fff-7f1001b9fb75" returned: 0 in 0.685s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-quobyte-8b30b1d0-7288-4756-9fff-7f1001b9fb75" released by "delete_volume" :: held 1.628s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:05 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e" returned: 0 in 0.739s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Created reservations ['6023dbbd-b24b-4f6b-9a2e-89358e3b48da', '92995b5f-7bc2-4739-8b3a-41e73016b597', 'f0288453-f74f-4f6d-bad8-3fba840fc18f', '896e435e-f757-4173-bb0a-24024543798f'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-936b45c4-23b0-4637-a9eb-f12ab0fa201e" released by "_copy_volume_from_snapshot" :: held 9.410s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-ffcc6a9e-e3c3-4fba-8a48-5401458581ce-936b45c4-23b0-4637-a9eb-f12ab0fa201e" released by "_create_volume_from_snapshot" :: held 9.454s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.480s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Creating offline snapshot 64307c7b-dde9-4585-8e2d-511b0a9ee5b4 of volume b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47131dd9-0827-49f0-b403-db2adf777e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e', 'volume_size': 1, 'snapshot_id': 'ffcc6a9e-e3c3-4fba-8a48-5401458581ce'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9980e968-43ad-4289-8689-923d363fdfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f007497b-687c-42ca-b20f-a90ffac57ae6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:05 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Volume volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e (936b45c4-23b0-4637-a9eb-f12ab0fa201e): created successfully Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9980e968-43ad-4289-8689-923d363fdfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Flow 'volume_create_manager' (80aad7d7-bcf3-4534-a9a2-4bcfbdd58a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:05 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-178fdad0-0200-40ae-a9f9-2c868ea60431 tempest-VolumesSnapshotTestJSON-685795700 None] Created volume successfully. Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:05 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:17:05 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e Jun 25 18:17:05 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:05 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:06 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e" returned: 0 in 1.260s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:06 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.171s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:06 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Deleted volume successfully. Jun 25 18:17:06 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 1G Jun 25 18:17:06 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f507387-3070-4e47-8b6b-eff9ff83ba1c tempest-AttachVolumeNegativeTest-1899965128 None] Lock "cinder-8b30b1d0-7288-4756-9fff-7f1001b9fb75-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-936b45c4-23b0-4637-a9eb-f12ab0fa201e-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-936b45c4-23b0-4637-a9eb-f12ab0fa201e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-936b45c4-23b0-4637-a9eb-f12ab0fa201e" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-936b45c4-23b0-4637-a9eb-f12ab0fa201e" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[43095bda-96a0-44ae-a8da-b368b66e430e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:06 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e Jun 25 18:17:06 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:07 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 1G" returned: 0 in 1.193s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:07 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e" returned: 0 in 0.974s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:07 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 Jun 25 18:17:07 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:07 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e Jun 25 18:17:07 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:08 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4" returned: 0 in 1.022s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:08 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 is being set with open permissions: ugo+rw Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:08 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:08 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 Jun 25 18:17:08 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-936b45c4-23b0-4637-a9eb-f12ab0fa201e" returned: 0 in 1.011s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-936b45c4-23b0-4637-a9eb-f12ab0fa201e" released by "delete_volume" :: held 2.053s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Created reservations ['dff5a2aa-df85-4e37-840f-4e3f610dfb65', 'ba88f9c0-7910-4977-9342-da0fc53ef843', 'a04f7f0b-22d3-46b7-80ee-645320fa9816', 'e1691568-7371-4f63-82dc-364646509465'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:08 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:17:08 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:09 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4" returned: 0 in 0.770s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.411s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:09 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2d9669b4-516f-4a7f-84e9-a3566da887e8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Create snapshot completed successfully Jun 25 18:17:09 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.707s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:09 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:09 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Deleted volume successfully. Jun 25 18:17:09 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5874df94-2631-4611-9139-4f426397d80d tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-936b45c4-23b0-4637-a9eb-f12ab0fa201e-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-ffcc6a9e-e3c3-4fba-8a48-5401458581ce-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-ffcc6a9e-e3c3-4fba-8a48-5401458581ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-86809da6-1b50-421d-95f6-4f02e8e5d674" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-86809da6-1b50-421d-95f6-4f02e8e5d674" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-ffcc6a9e-e3c3-4fba-8a48-5401458581ce" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-ffcc6a9e-e3c3-4fba-8a48-5401458581ce" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Deleting offline snapshot ffcc6a9e-e3c3-4fba-8a48-5401458581ce of volume 86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] snapshot_file for this snap is: volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cfafdc-0e19-4bf2-8d71-93e99a178177]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:10 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce Jun 25 18:17:10 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:11 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce" returned: 0 in 1.072s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86809da6-1b50-421d-95f6-4f02e8e5d674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c770a096-5c79-431b-b21b-c8884eff5bc9]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-64307c7b-dde9-4585-8e2d-511b0a9ee5b4-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-64307c7b-dde9-4585-8e2d-511b0a9ee5b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-quobyte-64307c7b-dde9-4585-8e2d-511b0a9ee5b4" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-64307c7b-dde9-4585-8e2d-511b0a9ee5b4" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Deleting offline snapshot 64307c7b-dde9-4585-8e2d-511b0a9ee5b4 of volume b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:17:11 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 Jun 25 18:17:11 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] snapshot_file for this snap is: volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab044eb-2555-448e-a512-67ca532d90d6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:11 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 Jun 25 18:17:11 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:12 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674" returned: 0 in 1.094s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:12 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce Jun 25 18:17:12 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:12 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4" returned: 0 in 1.151s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ade0e1-83b3-470b-889b-6cd5c2da949d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:12 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e Jun 25 18:17:12 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:13 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce" returned: 0 in 0.861s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:13 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce Jun 25 18:17:13 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:13 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e" returned: 0 in 0.945s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:13 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 Jun 25 18:17:13 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:14 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674.ffcc6a9e-e3c3-4fba-8a48-5401458581ce" returned: 0 in 0.807s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-ffcc6a9e-e3c3-4fba-8a48-5401458581ce" released by "_delete_snapshot" :: held 4.022s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-86809da6-1b50-421d-95f6-4f02e8e5d674" released by "delete_snapshot" :: held 4.055s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:14 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Created reservations ['54cd9aa2-a812-4549-9ce1-75ca39e960a1', '6a15ae8a-8c9f-41be-9604-5185d4ab229a', 'bf7fa958-0c38-4ea6-95df-636fce9eb08f', 'cd273df3-3030-4322-8bec-fa9efe535cdb'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:14 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Delete snapshot completed successfully. Jun 25 18:17:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2f2041b-295b-451b-8a9c-eeb9d7eb9a82 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-ffcc6a9e-e3c3-4fba-8a48-5401458581ce-delete_snapshot" released by "delete_snapshot" :: held 4.284s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:14 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4" returned: 0 in 1.128s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:14 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4 Jun 25 18:17:14 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Acquiring lock "cinder-01486fdb-6e51-40b8-abf8-c8ba0fe14502-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "cinder-01486fdb-6e51-40b8-abf8-c8ba0fe14502-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Acquiring lock "cinder-quobyte-01486fdb-6e51-40b8-abf8-c8ba0fe14502" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "cinder-quobyte-01486fdb-6e51-40b8-abf8-c8ba0fe14502" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[de681a7e-f23b-4320-8fe0-287274d03eab]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:15 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 Jun 25 18:17:15 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-86809da6-1b50-421d-95f6-4f02e8e5d674-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-86809da6-1b50-421d-95f6-4f02e8e5d674-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-86809da6-1b50-421d-95f6-4f02e8e5d674" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-86809da6-1b50-421d-95f6-4f02e8e5d674" acquired by "delete_volume" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc0c532-5e68-4969-8fac-5f1eb466632c]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:15 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.64307c7b-dde9-4585-8e2d-511b0a9ee5b4" returned: 0 in 0.931s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-64307c7b-dde9-4585-8e2d-511b0a9ee5b4" released by "_delete_snapshot" :: held 4.322s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" released by "delete_snapshot" :: held 4.365s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:15 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 Jun 25 18:17:15 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Flow 'volume_create_manager' (114c07dc-bd68-4d3d-b466-e08f73208092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48eba00-43d2-4cad-ba0d-69f9ea63d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48eba00-43d2-4cad-ba0d-69f9ea63d96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-369389888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9c1666-3e60-4188-94c9-217aaf98ecd2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d15f84fb5a4574afb632c7f80c24c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:16Z,use_quota=True,user_id='a7562e25a05a4070b2b6764c470e8e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61567bfd-1fed-423a-9e55-173dbe680ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61567bfd-1fed-423a-9e55-173dbe680ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f570a2d-67c4-4d4b-8ef1-eed65aee6e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f570a2d-67c4-4d4b-8ef1-eed65aee6e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9c1666-3e60-4188-94c9-217aaf98ecd2', 'volume_name': 'volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10271255-38c3-4858-823e-a50d142cd024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10271255-38c3-4858-823e-a50d142cd024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edab97f7-e7f1-4903-8557-0d2f92bcd52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:16 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Volume ac9c1666-3e60-4188-94c9-217aaf98ecd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2', 'volume_size': 1} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-369389888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9c1666-3e60-4188-94c9-217aaf98ecd2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d15f84fb5a4574afb632c7f80c24c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:16Z,use_quota=True,user_id='a7562e25a05a4070b2b6764c470e8e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Creating volume ac9c1666-3e60-4188-94c9-217aaf98ecd2 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:17:16 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Created reservations ['bbbe480d-7c81-4c3e-87a4-26e97ae20090', '9b614797-8049-4d9f-b030-6851e7bae0dc', '20cf5245-afd4-43f5-b7ed-08707e26b60d', 'f1c18f2e-0dc5-44ff-9c74-7a2e6d5b588b'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:16 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 1073741824 Jun 25 18:17:16 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:16 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502" returned: 0 in 1.020s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:16 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502 Jun 25 18:17:16 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:16 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Delete snapshot completed successfully. Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4523d799-0a2f-422f-b248-2f4789639fa8 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-64307c7b-dde9-4585-8e2d-511b0a9ee5b4-delete_snapshot" released by "delete_snapshot" :: held 4.713s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:16 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674" returned: 0 in 0.878s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:16 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674 Jun 25 18:17:16 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-826c21b4-b4b0-4e84-8308-ee0fa63ba95e-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-826c21b4-b4b0-4e84-8308-ee0fa63ba95e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-quobyte-826c21b4-b4b0-4e84-8308-ee0fa63ba95e" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-826c21b4-b4b0-4e84-8308-ee0fa63ba95e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Deleting offline snapshot 826c21b4-b4b0-4e84-8308-ee0fa63ba95e of volume b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:17:16 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] snapshot_file for this snap is: volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01486fdb-6e51-40b8-abf8-c8ba0fe14502" returned: 0 in 0.804s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[441eb33d-7a64-421a-a2fd-4cbfad6e77f2]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "cinder-quobyte-01486fdb-6e51-40b8-abf8-c8ba0fe14502" released by "delete_volume" :: held 1.887s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Created reservations ['349cba48-5569-48ed-8164-8955fed5b8e0', '55f98cce-9aeb-491c-a72e-3ca1e0e1d9fb', '51fa237d-d614-4254-ab1a-0efdd8123050', '1e8eaaac-d714-416e-bcf3-76ca46cfadd4'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:17 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e Jun 25 18:17:17 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:17 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 1073741824" returned: 0 in 1.018s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:17 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:17 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:17 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:17:17 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:17 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-86809da6-1b50-421d-95f6-4f02e8e5d674" returned: 0 in 0.871s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-86809da6-1b50-421d-95f6-4f02e8e5d674" released by "delete_volume" :: held 1.854s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Created reservations ['50d173fb-a482-4ec0-8c71-3e422faf2012', 'eb8720d3-e310-45d7-a79a-e61cd8a6efb4', 'e1566f47-9879-40a4-bd01-dd9f5738a3f8', 'bc3c8589-57eb-4568-862a-10ba61082c51'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:17 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:17:17 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:18 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2" returned: 0 in 0.920s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edab97f7-e7f1-4903-8557-0d2f92bcd52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d4f4dd-138a-4a18-913f-ff1bc3c4e84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:18 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Volume volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 (ac9c1666-3e60-4188-94c9-217aaf98ecd2): created successfully Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d4f4dd-138a-4a18-913f-ff1bc3c4e84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Flow 'volume_create_manager' (114c07dc-bd68-4d3d-b466-e08f73208092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-7cc79871-d81c-4413-9781-09b073667af9 req-9ec3eb76-31a8-4136-b172-d2d58f1a187d tempest-VolumesGetTestJSON-927682732 None] Created volume successfully. Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "cinder-quobyte-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:18 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e" returned: 0 in 1.316s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75d4516-07b5-4ee4-8887-f625388e3a4d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[08019fa4-3759-4ade-a76d-25f07ccae942]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:18 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 Jun 25 18:17:18 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:18 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 Jun 25 18:17:18 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:18 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.415s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:18 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Deleted volume successfully. Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.832s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Deleted volume successfully. Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1e4edf6b-fefa-4cb1-b760-2e3248f716b8 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-86809da6-1b50-421d-95f6-4f02e8e5d674-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7923a302-435d-4bf0-aac1-096a68940225 tempest-AttachVolumeShelveTestJSON-1431210834 None] Lock "cinder-01486fdb-6e51-40b8-abf8-c8ba0fe14502-delete_volume" released by "delete_volume" :: held 3.730s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:19 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" returned: 0 in 0.962s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:19 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e Jun 25 18:17:19 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:19 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" returned: 0 in 1.032s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:19 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3 Jun 25 18:17:19 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Acquiring lock "cinder-ac9c1666-3e60-4188-94c9-217aaf98ecd2-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Lock "cinder-ac9c1666-3e60-4188-94c9-217aaf98ecd2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Acquiring lock "cinder-quobyte-ac9c1666-3e60-4188-94c9-217aaf98ecd2" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Lock "cinder-quobyte-ac9c1666-3e60-4188-94c9-217aaf98ecd2" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eb9e80-e663-4979-b7c9-c5025d7dd7f8]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:19 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 Jun 25 18:17:19 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:20 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" returned: 0 in 0.972s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-quobyte-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3" released by "delete_volume" :: held 2.094s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:20 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e" returned: 0 in 1.149s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Created reservations ['213beb4e-51a1-493e-b836-d84500ae91d9', '46a4687b-8327-4a2f-8b94-35ac3f9e78a2', '94271d45-b5e0-474d-ac44-5c353f78da63', '4e0f4f7d-136f-427d-9e2d-5862b2525222'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:20 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e Jun 25 18:17:20 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:20 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:17:20 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:20 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2" returned: 0 in 1.092s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:20 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2 Jun 25 18:17:20 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.826c21b4-b4b0-4e84-8308-ee0fa63ba95e" returned: 0 in 0.911s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:21 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-826c21b4-b4b0-4e84-8308-ee0fa63ba95e" released by "_delete_snapshot" :: held 4.562s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:21 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" released by "delete_snapshot" :: held 4.623s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.996s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:21 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Deleted volume successfully. Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Created reservations ['201ee6c6-fe74-45c9-a223-efe8ae25e1f4', '7172e5cb-ca89-4db6-a941-fe79da035e98', '99a172a3-00b3-4a2f-a3d4-febc73439a85', '1994aef9-f832-4e41-bb45-dcf122a9db1b'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a129cef3-2397-4657-8eef-6e9c726b8f84 tempest-VolumesSnapshotTestJSON-685795700 None] Lock "cinder-c76fe6ac-4255-418c-9e7d-9dbdaf0683c3-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:21 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Delete snapshot completed successfully. Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4d1f39cb-01fc-4972-8120-34b8b79d4136 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-826c21b4-b4b0-4e84-8308-ee0fa63ba95e-delete_snapshot" released by "delete_snapshot" :: held 4.873s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:21 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ac9c1666-3e60-4188-94c9-217aaf98ecd2" returned: 0 in 0.949s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Lock "cinder-quobyte-ac9c1666-3e60-4188-94c9-217aaf98ecd2" released by "delete_volume" :: held 2.104s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:21 devstack cinder-volume[93767]: DEBUG cinder.quota [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Created reservations ['5402eae3-7f6f-44a1-835c-1e23101b311d', 'aabc0a03-2011-4ff1-9e9c-bec2326f5e85', 'edb85e75-3156-4330-8dcf-a9b95485cd99', '01278299-a791-421f-9075-293f39509a03'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:22 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:17:22 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-d1dbcdbf-2f3b-4639-ab47-d6f412a34de8-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-d1dbcdbf-2f3b-4639-ab47-d6f412a34de8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-quobyte-d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Deleting offline snapshot d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 of volume b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] snapshot_file for this snap is: volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d66020a-924a-426c-987c-76c67c65abb8]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:22 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 Jun 25 18:17:22 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:23 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.213s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:23 devstack cinder-volume[93767]: DEBUG cinder.manager [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Deleted volume successfully. Jun 25 18:17:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-f3ab53a4-e8c8-45a3-abaf-2940caff88f7 req-0bdfbcad-7ce4-4f1e-8d46-1d2c67f98444 tempest-VolumesGetTestJSON-927682732 None] Lock "cinder-ac9c1666-3e60-4188-94c9-217aaf98ecd2-delete_volume" released by "delete_volume" :: held 3.679s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:23 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" returned: 0 in 1.260s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ccda67-30b8-4ce5-be22-77f4e4f56d45]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:23 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 Jun 25 18:17:23 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:24 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" returned: 0 in 0.960s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:24 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 Jun 25 18:17:24 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:25 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" returned: 0 in 1.061s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:25 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8 Jun 25 18:17:25 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:26 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595.d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" returned: 0 in 1.177s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-d1dbcdbf-2f3b-4639-ab47-d6f412a34de8" released by "_delete_snapshot" :: held 4.675s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" released by "delete_snapshot" :: held 4.716s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:27 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Created reservations ['a6ba1824-9efb-44f5-8241-5fb638945aaf', 'e735987f-5d9f-4d40-bd17-d7f43cf823a6', '74412d11-b3d9-4f08-8379-002b316d2fb4', 'c3eff4c7-01cb-4636-a467-8910cf79641c'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:27 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Delete snapshot completed successfully. Jun 25 18:17:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6f32259d-6fb1-4db5-99fc-ec79173349bf tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-d1dbcdbf-2f3b-4639-ab47-d6f412a34de8-delete_snapshot" released by "delete_snapshot" :: held 4.923s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-b20ac6d4-e1c1-487d-88c6-ac3c764f8595-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-b20ac6d4-e1c1-487d-88c6-ac3c764f8595-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" acquired by "delete_volume" :: waited 0.032s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:28 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f106ad9c-3706-4f3f-a955-228a0d65cdb4]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:28 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 Jun 25 18:17:28 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a18fa570-3685-45cd-9322-d596ce7b696a tempest-BackendsCapabilitiesAdminTestsJSON-954449804 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6699256896973, 'free_capacity_gb': 1775.6699256896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93767) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:5462}} Jun 25 18:17:29 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" returned: 0 in 1.005s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:29 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595 Jun 25 18:17:29 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-54c6fbdc-c91c-40e1-a029-9dea42e46147 tempest-BackendsCapabilitiesAdminTestsJSON-954449804 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6699256896973, 'free_capacity_gb': 1775.6699256896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93767) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:5462}} Jun 25 18:17:30 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" returned: 0 in 0.941s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-quobyte-b20ac6d4-e1c1-487d-88c6-ac3c764f8595" released by "delete_volume" :: held 2.047s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:30 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Created reservations ['92f9f2f1-1d96-450e-a41d-7ff6b5897d71', 'bf537961-46cb-40ae-b51f-a73f31697992', '5a5638a8-1217-4380-a21e-b00db7cf1bb1', '769d1917-3b82-4db6-84b4-a434e552f98b'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:30 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:17:30 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:31 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.809s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:31 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Deleted volume successfully. Jun 25 18:17:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6719c013-d6be-441c-ac1b-790ca5768580 tempest-VolumesSnapshotListTestJSON-1525991737 None] Lock "cinder-b20ac6d4-e1c1-487d-88c6-ac3c764f8595-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:40 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:DELETE=10,cinder:SELECT=99,cinder:UPDATE=110,cinder:INSERT=28 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:17:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:17:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:40 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:17:40 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:41 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=82,cinder:UPDATE=113,cinder:DELETE=8,cinder:INSERT=29 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:17:41 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.434s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:17:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:17:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Flow 'volume_create_manager' (64c876a0-bdbc-4527-a29f-52ee5d7cc7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481017e1-bdad-4491-b33c-b09edccdccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481017e1-bdad-4491-b33c-b09edccdccac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-99142541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f541d56b-e126-4e24-98ac-2b8ac8c86853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82574328dd841c7978b5758da76b956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:43Z,use_quota=True,user_id='49cad4482e24460cbf906f8e2f44ba28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8a28f5-912c-4a29-a4d5-ab27238f7f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8a28f5-912c-4a29-a4d5-ab27238f7f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c4818b-1f91-4154-8ef9-b664c96f8098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c4818b-1f91-4154-8ef9-b664c96f8098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f541d56b-e126-4e24-98ac-2b8ac8c86853', 'volume_name': 'volume-f541d56b-e126-4e24-98ac-2b8ac8c86853', 'volume_size': 2}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7bfe99-d0be-4fe0-a2c0-4c26c7eb1c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7bfe99-d0be-4fe0-a2c0-4c26c7eb1c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5cb9c5-3e2b-47c2-b615-e8f6eb80b8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:43 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Volume f541d56b-e126-4e24-98ac-2b8ac8c86853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f541d56b-e126-4e24-98ac-2b8ac8c86853', 'volume_size': 2} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-99142541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f541d56b-e126-4e24-98ac-2b8ac8c86853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82574328dd841c7978b5758da76b956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:43Z,use_quota=True,user_id='49cad4482e24460cbf906f8e2f44ba28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Creating volume f541d56b-e126-4e24-98ac-2b8ac8c86853 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:17:43 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:17:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 2147483648 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:43 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 2147483648 Jun 25 18:17:43 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:44 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 2147483648" returned: 0 in 1.676s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:45 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 Jun 25 18:17:45 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5d7ffa20-6f0b-4b63-adeb-4f527d0d0a9a tempest-GroupSnapshotsTest-1956636196 None] Group tempest-GroupSnapshotsTest-Group-841398733: creating Jun 25 18:17:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5d7ffa20-6f0b-4b63-adeb-4f527d0d0a9a tempest-GroupSnapshotsTest-1956636196 None] Group tempest-GroupSnapshotsTest-Group-841398733: created successfully Jun 25 18:17:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5d7ffa20-6f0b-4b63-adeb-4f527d0d0a9a tempest-GroupSnapshotsTest-1956636196 None] Create group completed successfully. Jun 25 18:17:46 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853" returned: 0 in 1.023s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] <== create_volume: return (2770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.772s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5cb9c5-3e2b-47c2-b615-e8f6eb80b8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f541d56b-e126-4e24-98ac-2b8ac8c86853', 'volume_size': 2}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e0283e-0045-4a1e-b470-9dda4aa33332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:46 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Volume volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 (f541d56b-e126-4e24-98ac-2b8ac8c86853): created successfully Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e0283e-0045-4a1e-b470-9dda4aa33332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Flow 'volume_create_manager' (64c876a0-bdbc-4527-a29f-52ee5d7cc7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:46 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-75363fb7-fae4-40f3-a4bc-daaa6f1fe714 tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Created volume successfully. Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Creating offline snapshot efef8313-868d-4064-8ee3-8388b652e599 of volume f541d56b-e126-4e24-98ac-2b8ac8c86853 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c873ace-65fe-4aad-9dd7-f7bf78b0d9f3]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:47 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 Jun 25 18:17:47 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Flow 'volume_create_manager' (29209197-1b12-418f-8a7a-efe0f9a2eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76814410-919f-48e0-95bd-bdb315ce57ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76814410-919f-48e0-95bd-bdb315ce57ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361090586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62d4e990-7587-4901-80e2-6d96212c3c75,host='devstack@QuobyteHD#QuobyteHD',id=2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097751983a474b28b6656f85dd52710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:47Z,use_quota=True,user_id='e239702e5a7b4cd7ba08cd159c9492d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99232b4a-d831-45b3-bcc0-e110eedd1518),volume_type_id=99232b4a-d831-45b3-bcc0-e110eedd1518)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd70539a-2193-4b95-9c19-c2067090cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd70539a-2193-4b95-9c19-c2067090cbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ae1fce-c3f6-433b-946b-526934b37f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ae1fce-c3f6-433b-946b-526934b37f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e', 'volume_name': 'volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99a38d5-f84e-4853-81fb-ace7bd862285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99a38d5-f84e-4853-81fb-ace7bd862285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e21ad2-281d-466b-9c07-3780cec8f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Volume 2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e', 'volume_size': 1} Jun 25 18:17:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:48 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853" returned: 0 in 1.311s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 2G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:48 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 2G Jun 25 18:17:48 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:49 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 2G" returned: 0 in 1.315s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:49 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 Jun 25 18:17:49 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:50 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599" returned: 0 in 0.963s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:50 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 is being set with open permissions: ugo+rw Jun 25 18:17:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:50 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 Jun 25 18:17:50 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:51 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599" returned: 0 in 0.769s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:51 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.info Jun 25 18:17:51 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:52 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.info" returned: 0 in 0.760s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:52 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.info is being set with open permissions: ugo+rw Jun 25 18:17:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:52 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.info Jun 25 18:17:52 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:52 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.info" returned: 0 in 0.838s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.088s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.468s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62d4e990-7587-4901-80e2-6d96212c3c75,created_at=2026-06-25T16:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361090586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62d4e990-7587-4901-80e2-6d96212c3c75,host='devstack@QuobyteHD#QuobyteHD',id=2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097751983a474b28b6656f85dd52710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:47Z,use_quota=True,user_id='e239702e5a7b4cd7ba08cd159c9492d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99232b4a-d831-45b3-bcc0-e110eedd1518),volume_type_id=99232b4a-d831-45b3-bcc0-e110eedd1518)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Creating volume 2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:17:53 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:53 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e 1073741824 Jun 25 18:17:53 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:53 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-13714120-47f5-4edb-ad58-a6afe70a65bc tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Create snapshot completed successfully Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Acquiring lock "cinder-efef8313-868d-4064-8ee3-8388b652e599-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-efef8313-868d-4064-8ee3-8388b652e599-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Acquiring lock "cinder-quobyte-f541d56b-e126-4e24-98ac-2b8ac8c86853" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-quobyte-f541d56b-e126-4e24-98ac-2b8ac8c86853" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Acquiring lock "cinder-quobyte-efef8313-868d-4064-8ee3-8388b652e599" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-quobyte-efef8313-868d-4064-8ee3-8388b652e599" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Deleting offline snapshot efef8313-868d-4064-8ee3-8388b652e599 of volume f541d56b-e126-4e24-98ac-2b8ac8c86853 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] snapshot_file for this snap is: volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4af06a-a4e6-4ca2-9300-28d18f887636]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:53 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 Jun 25 18:17:53 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:54 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e 1073741824" returned: 0 in 1.085s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:54 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e Jun 25 18:17:54 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:54 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599" returned: 0 in 1.190s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f541d56b-e126-4e24-98ac-2b8ac8c86853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:54 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc6a2b5-0304-4cd4-99e0-fbb8993ece9d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:55 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 Jun 25 18:17:55 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:55 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" returned: 0 in 1.123s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:17:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e21ad2-281d-466b-9c07-3780cec8f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f4c1ba-31c0-4855-9c59-66aa81d84c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:55 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Volume volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e (2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e): created successfully Jun 25 18:17:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f4c1ba-31c0-4855-9c59-66aa81d84c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Flow 'volume_create_manager' (29209197-1b12-418f-8a7a-efe0f9a2eae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:55 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-557b812e-67a6-48d1-b6e7-29b3afc6ba78 tempest-GroupSnapshotsTest-1956636196 None] Created volume successfully. Jun 25 18:17:55 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853" returned: 0 in 1.069s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:56 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 Jun 25 18:17:56 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:56 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] GroupSnapshot 61979db0-1858-41a4-be28-73175cd3ef50: creating. Jun 25 18:17:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Group snapshot 61979db0-1858-41a4-be28-73175cd3ef50: creating. {{(pid=93767) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4755}} Jun 25 18:17:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Creating offline snapshot a0fbb523-49ec-4681-abe8-c0ccd57f4623 of volume 2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:17:56 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[47edeaf5-d158-4861-af6a-16816bb68077]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:57 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e Jun 25 18:17:57 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:57 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599" returned: 0 in 1.143s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:57 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599 Jun 25 18:17:57 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:57 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" returned: 0 in 0.982s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:57 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 1G Jun 25 18:17:57 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:57 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853.efef8313-868d-4064-8ee3-8388b652e599" returned: 0 in 0.872s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-quobyte-efef8313-868d-4064-8ee3-8388b652e599" released by "_delete_snapshot" :: held 4.515s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-quobyte-f541d56b-e126-4e24-98ac-2b8ac8c86853" released by "delete_snapshot" :: held 4.547s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:58 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Created reservations ['77cf76e1-4a05-497c-83d4-f741a7f45a71', 'b0a328c2-b6ef-4b58-82bf-e21f4ebdb24b', '53bb1d2d-13db-4903-b791-b65a2e0a50a3', '16a5f2c6-abc1-4a5f-b5ba-52bde2334305'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:58 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Delete snapshot completed successfully. Jun 25 18:17:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a713ef52-01b0-410c-a59b-9066b83b6a0a tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-efef8313-868d-4064-8ee3-8388b652e599-delete_snapshot" released by "delete_snapshot" :: held 4.783s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:58 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 1G" returned: 0 in 1.079s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Acquiring lock "cinder-f541d56b-e126-4e24-98ac-2b8ac8c86853-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:58 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 Jun 25 18:17:58 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-f541d56b-e126-4e24-98ac-2b8ac8c86853-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Acquiring lock "cinder-quobyte-f541d56b-e126-4e24-98ac-2b8ac8c86853" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-quobyte-f541d56b-e126-4e24-98ac-2b8ac8c86853" acquired by "delete_volume" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:59 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b60416-b8c8-472c-b6db-7f9540791b3e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:59 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 Jun 25 18:17:59 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:59 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623" returned: 0 in 0.943s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:59 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:17:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:59 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 Jun 25 18:17:59 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:00 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853" returned: 0 in 0.887s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:00 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853 Jun 25 18:18:00 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:00 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623" returned: 0 in 0.753s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:00 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.info Jun 25 18:18:00 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:00 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f541d56b-e126-4e24-98ac-2b8ac8c86853" returned: 0 in 0.771s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-quobyte-f541d56b-e126-4e24-98ac-2b8ac8c86853" released by "delete_volume" :: held 1.766s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:01 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Created reservations ['85d2e6a9-2a30-48cc-9e8d-f3aad49a705f', '9ad25eca-af20-48ae-b53a-15a452db7f97', 'f81ac8ad-c70f-4af7-af81-363a7ca0d7eb', 'a82103b8-94ea-4695-91bf-1885be21ce00'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:01 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:01 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:18:01 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:01 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.info" returned: 0 in 1.131s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:01 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:18:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:01 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.info Jun 25 18:18:01 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:02 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.973s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:02 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Deleted volume successfully. Jun 25 18:18:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-68356eee-721b-494b-95d0-9288601699cb tempest-VolumesSnapshotNegativeTestJSON-1795791736 None] Lock "cinder-f541d56b-e126-4e24-98ac-2b8ac8c86853-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:02 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.info" returned: 0 in 0.838s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.882s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-874abd59-821c-49e9-befd-71b3b33d61c2 tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 61979db0-1858-41a4-be28-73175cd3ef50: created successfully Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-a0fbb523-49ec-4681-abe8-c0ccd57f4623-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" by "_create_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-a0fbb523-49ec-4681-abe8-c0ccd57f4623-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Creating volume e59d9cba-92f9-4434-b1cb-c1adf6091ab6 from snapshot a0fbb523-49ec-4681-abe8-c0ccd57f4623 {{(pid=93767) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] snapshot: a0fbb523-49ec-4681-abe8-c0ccd57f4623, volume: e59d9cba-92f9-4434-b1cb-c1adf6091ab6, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:18:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:05 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7837f6-a7c0-4500-a7e4-45215a11a497]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:05 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 Jun 25 18:18:05 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:06 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623" returned: 0 in 1.498s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:18:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:18:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:18:06 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf3e670-c691-4212-b080-e91b795ba15b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:06 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e Jun 25 18:18:06 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:08 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" returned: 0 in 1.738s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:08 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:18:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:08 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 Jun 25 18:18:08 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:14 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=24,cinder:SELECT=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:18:14 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:18:17 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" returned: 0 in 9.154s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:17 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af82e87-1190-497e-b898-28ef30f7a387]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:17 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e Jun 25 18:18:17 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:18 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" returned: 0 in 1.065s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:18 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e, size 1024.00 MB, duration 9.16 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:18:18 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Converted 1024.00 MB image at 111.85 MB/s Jun 25 18:18:18 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:18:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:18 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 Jun 25 18:18:18 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:19 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" returned: 0 in 0.695s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" released by "_copy_volume_from_snapshot" :: held 14.374s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-a0fbb523-49ec-4681-abe8-c0ccd57f4623-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" released by "_create_volume_from_snapshot" :: held 14.414s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.450s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f4d796a4-7424-4f95-acd4-0f2230bde8e5 tempest-GroupSnapshotsTest-1956636196 None] Create group from source-snapshot-61979db0-1858-41a4-be28-73175cd3ef50 completed successfully. Jun 25 18:18:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[386cd808-87d1-4356-a080-6dd42465189c]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:23 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 Jun 25 18:18:23 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:24 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" returned: 0 in 0.868s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:24 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6 Jun 25 18:18:24 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Flow 'volume_create_manager' (bf053c6c-87a4-4f8e-a666-8818ea0cbe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d42544-a927-40f6-bd86-0a9adae2173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d42544-a927-40f6-bd86-0a9adae2173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-801156296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9cced3b-d65b-4ace-9f5d-a00494bf7112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4507942a391f4d528d77b2388e075695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:25Z,use_quota=True,user_id='619be340616c4872a708f791ae974846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849cfa7e-3773-4dce-976a-2f8acb64516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849cfa7e-3773-4dce-976a-2f8acb64516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a01299-7f4d-46d5-8ddc-195095948a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.image.glance [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Creating Keystone auth plugin from conf {{(pid=93767) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:18:25 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" returned: 0 in 1.023s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-e59d9cba-92f9-4434-b1cb-c1adf6091ab6" released by "delete_volume" :: held 1.969s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a01299-7f4d-46d5-8ddc-195095948a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9cced3b-d65b-4ace-9f5d-a00494bf7112', 'volume_name': 'volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13faac2b-6cf4-48dc-a3dd-59a7a5dec78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13faac2b-6cf4-48dc-a3dd-59a7a5dec78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817f1765-046b-43bb-964b-7fc7aaf93831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:25 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Volume d9cced3b-d65b-4ace-9f5d-a00494bf7112: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Trying to clone d9cced3b-d65b-4ace-9f5d-a00494bf7112 from image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]). {{(pid=93767) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['5e9361a6-7207-4a9d-b22d-3bbcbdc302f2'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:25 devstack cinder-volume[93767]: WARNING cinder.quota [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-748115431 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-748115431, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:18:25 devstack cinder-volume[93767]: WARNING cinder.quota [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-748115431 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-748115431, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:18:25 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['bf9cb1b2-4461-49c3-a0f1-91d27c711fd5', 'a3a95d29-cc30-4735-b6ab-e03de2133761', '7c195ea8-3c06-4ece-a576-1924071087ac', 'd7e3ec7b-4192-4713-8d20-4973f643edfb'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:26 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:18:26 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:18:26 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Image download 20.69 MB at 20.69 MB/s Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a472ca0-79d4-4dd1-98c5-5412335ddbbd]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:26 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD Jun 25 18:18:26 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:26 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 61979db0-1858-41a4-be28-73175cd3ef50: deleting Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 61979db0-1858-41a4-be28-73175cd3ef50: deleting {{(pid=93767) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4930}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-a0fbb523-49ec-4681-abe8-c0ccd57f4623" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-a0fbb523-49ec-4681-abe8-c0ccd57f4623" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Deleting offline snapshot a0fbb523-49ec-4681-abe8-c0ccd57f4623 of volume 2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] snapshot_file for this snap is: volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e279c30e-ac61-4c65-8e90-0b84e85215f8]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:27 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 Jun 25 18:18:27 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:27 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.218s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:27 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:27 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c2b6d4c0-1a2f-42bf-9e4e-1facce8e745a tempest-GroupSnapshotsTest-1956636196 None] Delete group completed successfully. Jun 25 18:18:27 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD" returned: 0 in 1.264s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:27 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Temporary image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f is fetched for user 619be340616c4872a708f791ae974846. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:18:27 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a06617-aab8-48ba-90b9-b2575c0947bb]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:27 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD Jun 25 18:18:27 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:28 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623" returned: 0 in 1.479s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b0c91a-a0fa-4a75-9415-1707c31796ac]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:28 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e Jun 25 18:18:28 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:28 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD" returned: 0 in 1.204s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-801156296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9cced3b-d65b-4ace-9f5d-a00494bf7112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4507942a391f4d528d77b2388e075695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:25Z,use_quota=True,user_id='619be340616c4872a708f791ae974846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Creating volume d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:28 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:18:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:28 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 1073741824 Jun 25 18:18:29 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:29 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" returned: 0 in 1.124s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:29 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 Jun 25 18:18:29 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:30 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 1073741824" returned: 0 in 1.123s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:30 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:18:30 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:30 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623" returned: 0 in 0.984s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:30 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623 Jun 25 18:18:30 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:30 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 0 in 0.853s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:31 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Attempting download of cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}])) to volume d9cced3b-d65b-4ace-9f5d-a00494bf7112. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:18:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3abdc81-aa7a-4bea-b3c5-368529c350f8]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_spw9uv_n {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:31 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_spw9uv_n Jun 25 18:18:31 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:31 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e.a0fbb523-49ec-4681-abe8-c0ccd57f4623" returned: 0 in 0.914s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-a0fbb523-49ec-4681-abe8-c0ccd57f4623" released by "_delete_snapshot" :: held 4.674s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" released by "delete_snapshot" :: held 4.722s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:31 devstack cinder-volume[93767]: WARNING cinder.quota [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-748115431 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-748115431, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:18:31 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['efa2a288-ee35-4c05-911c-a14c0f2d2c1c', '0b083b33-dab6-4a60-881a-2c68fd5f7be4', '70078618-6021-4399-a619-a9d467943c85', '97dde5f4-d5b6-4440-8c42-bb0354643d3b'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-721152c9-844a-4e18-b6b4-a2a274c84873 tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 61979db0-1858-41a4-be28-73175cd3ef50: deleted successfully Jun 25 18:18:32 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_spw9uv_n" returned: 0 in 0.904s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_spw9uv_n {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:32 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_spw9uv_n Jun 25 18:18:32 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:32 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_spw9uv_n" returned: 1 in 0.863s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_spw9uv_n' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f01f0c5-8b69-43b6-b18d-97ca9f9cd8c6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7305a20-17c6-49dd-b34d-f823d4840977]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:33 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e Jun 25 18:18:33 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:33 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD Jun 25 18:18:33 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Flow 'volume_create_manager' (bfa652a8-fab1-41e4-ba37-1135c83c38e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2712e5d8-f874-4c38-a0a6-95e0f1021b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2712e5d8-f874-4c38-a0a6-95e0f1021b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1895802025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b59043-909b-4287-b5ae-df5783fb50df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a22ca36985840cf8bd9c0d087652a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:34Z,use_quota=True,user_id='cf857bc247cb4933815411b87f445aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b716da8-c379-4cae-9ca6-53ec9e65fc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b716da8-c379-4cae-9ca6-53ec9e65fc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b58bbdc-a181-4462-8136-0dce39935844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b58bbdc-a181-4462-8136-0dce39935844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b59043-909b-4287-b5ae-df5783fb50df', 'volume_name': 'volume-18b59043-909b-4287-b5ae-df5783fb50df', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca2a1d4-68da-477e-b302-73f0af4afb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca2a1d4-68da-477e-b302-73f0af4afb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20195004-a7d3-4bb8-88b4-31cb67b898da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:33 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Volume 18b59043-909b-4287-b5ae-df5783fb50df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b59043-909b-4287-b5ae-df5783fb50df', 'volume_size': 1} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1895802025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b59043-909b-4287-b5ae-df5783fb50df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a22ca36985840cf8bd9c0d087652a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:34Z,use_quota=True,user_id='cf857bc247cb4933815411b87f445aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Creating volume 18b59043-909b-4287-b5ae-df5783fb50df {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:33 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:33 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" returned: 0 in 1.044s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:33 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df 1073741824 Jun 25 18:18:33 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:33 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e Jun 25 18:18:33 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:34 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD" returned: 0 in 1.292s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:34 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f was qcow2, converting to raw {{(pid=93767) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:18:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:34 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:18:34 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:34 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" returned: 0 in 0.790s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-2a70a6dd-cab3-4f78-a50c-d9f282c9ce2e" released by "delete_volume" :: held 1.948s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:34 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['56ca1ac5-a7b5-4971-9a6b-738fe6721627'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:34 devstack cinder-volume[93767]: WARNING cinder.db.api [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-748115431'] Jun 25 18:18:34 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['31790c6b-94e3-4fba-9157-d45e947fa9ed', '3565bf98-424d-41ae-8f1d-d06d2cc2b84d', 'fc0f9178-5db6-4e24-a309-7fbe53e0807b', 'b730cc46-cb60-4e2f-9db7-3eef3730932c'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:35 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df 1073741824" returned: 0 in 1.107s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:35 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:18:35 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:35 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df Jun 25 18:18:35 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:36 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.107s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:36 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c1f04f1d-bf46-4a59-a16a-41002fc68ff0 tempest-GroupSnapshotsTest-1956636196 None] Delete group completed successfully. Jun 25 18:18:36 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6ebc501e-051a-4189-9837-fe00d92ae9ea tempest-GroupSnapshotsTest-1956636196 None] Group tempest-GroupSnapshotsTest-Group-2079768824: creating Jun 25 18:18:36 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df" returned: 0 in 1.164s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] <== create_volume: return (2357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:36 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6ebc501e-051a-4189-9837-fe00d92ae9ea tempest-GroupSnapshotsTest-1956636196 None] Group tempest-GroupSnapshotsTest-Group-2079768824: created successfully Jun 25 18:18:36 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6ebc501e-051a-4189-9837-fe00d92ae9ea tempest-GroupSnapshotsTest-1956636196 None] Create group completed successfully. Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20195004-a7d3-4bb8-88b4-31cb67b898da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b59043-909b-4287-b5ae-df5783fb50df', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bfa2fa-533c-46c9-87fa-9e6b72397643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:36 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Volume volume-18b59043-909b-4287-b5ae-df5783fb50df (18b59043-909b-4287-b5ae-df5783fb50df): created successfully Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bfa2fa-533c-46c9-87fa-9e6b72397643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Flow 'volume_create_manager' (bfa652a8-fab1-41e4-ba37-1135c83c38e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:36 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c4067b1b-8fbe-4e66-b93f-b49f980d753d tempest-AttachVolumeTestJSON-1045690878 None] Created volume successfully. Jun 25 18:18:36 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 0 in 2.599s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_pz70iv8rdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:18:36 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Converted 112.00 MB image at 43.07 MB/s Jun 25 18:18:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:36 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 1G Jun 25 18:18:36 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:37 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 1G" returned: 0 in 0.973s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:37 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[da77c96b-726f-4086-b166-b68f0682eb8d]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:37 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:18:37 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Flow 'volume_create_manager' (7cd39b00-32a0-454a-9f5a-bd9300c2b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f189ffe-d6f1-414f-96f5-e791c66fc5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f189ffe-d6f1-414f-96f5-e791c66fc5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1631296099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2073422-5e70-4207-bceb-0e975f1861e7,host='devstack@QuobyteHD#QuobyteHD',id=6d16d8fc-ed36-4625-b7a2-7e9c93c77f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097751983a474b28b6656f85dd52710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:38Z,use_quota=True,user_id='e239702e5a7b4cd7ba08cd159c9492d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4cba782-df28-4c19-8d3d-1194458a54ea),volume_type_id=c4cba782-df28-4c19-8d3d-1194458a54ea)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02976c0-0a7d-49a2-94f6-791f5464dd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02976c0-0a7d-49a2-94f6-791f5464dd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90daac73-9993-4471-ac58-056764f2cb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90daac73-9993-4471-ac58-056764f2cb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d16d8fc-ed36-4625-b7a2-7e9c93c77f24', 'volume_name': 'volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fe7fbf-bcba-4015-b747-556fbf1af614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fe7fbf-bcba-4015-b747-556fbf1af614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1961b9-3457-4051-afd4-baee149cf04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:38 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Volume 6d16d8fc-ed36-4625-b7a2-7e9c93c77f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24', 'volume_size': 1} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e2073422-5e70-4207-bceb-0e975f1861e7,created_at=2026-06-25T16:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1631296099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2073422-5e70-4207-bceb-0e975f1861e7,host='devstack@QuobyteHD#QuobyteHD',id=6d16d8fc-ed36-4625-b7a2-7e9c93c77f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097751983a474b28b6656f85dd52710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:38Z,use_quota=True,user_id='e239702e5a7b4cd7ba08cd159c9492d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4cba782-df28-4c19-8d3d-1194458a54ea),volume_type_id=c4cba782-df28-4c19-8d3d-1194458a54ea)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Creating volume 6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:38 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:38 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 1073741824 Jun 25 18:18:38 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:38 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 0 in 0.905s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:38 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:18:38 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:39 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 1073741824" returned: 0 in 1.265s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:39 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 Jun 25 18:18:39 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:39 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 1 in 1.102s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Downloaded image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}])) to volume d9cced3b-d65b-4ace-9f5d-a00494bf7112 successfully. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Temporary image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f for user 619be340616c4872a708f791ae974846 is deleted. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Marking volume d9cced3b-d65b-4ace-9f5d-a00494bf7112 as bootable. {{(pid=93767) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Copying metadata from image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f to d9cced3b-d65b-4ace-9f5d-a00494bf7112. {{(pid=93767) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Creating volume glance metadata for volume d9cced3b-d65b-4ace-9f5d-a00494bf7112 backed by image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93767) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817f1765-046b-43bb-964b-7fc7aaf93831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d563ada0-1c52-4df9-bbf4-810b8a47d5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:40 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Volume volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 (d9cced3b-d65b-4ace-9f5d-a00494bf7112): created successfully Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d563ada0-1c52-4df9-bbf4-810b8a47d5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Flow 'volume_create_manager' (bf053c6c-87a4-4f8e-a666-8818ea0cbe85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:40 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1cf6f36c-94e5-4156-af2b-c6eeace44b74 tempest-TestShelveInstance-799047132 None] Created volume successfully. Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-69ab59f8-9a0e-4d93-b553-c22458811f66 req-68a11a74-3fa4-45d6-84fd-d035aa75dcb8 tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:40 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" returned: 0 in 0.807s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] <== create_volume: return (2150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-69ab59f8-9a0e-4d93-b553-c22458811f66 req-68a11a74-3fa4-45d6-84fd-d035aa75dcb8 tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.164s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1961b9-3457-4051-afd4-baee149cf04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92711cb-808e-44cf-8233-b64cb9a3ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a0f041-b558-490a-9fac-d35a87200fd5]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-69ab59f8-9a0e-4d93-b553-c22458811f66 req-68a11a74-3fa4-45d6-84fd-d035aa75dcb8 tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:40 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Volume volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 (6d16d8fc-ed36-4625-b7a2-7e9c93c77f24): created successfully Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92711cb-808e-44cf-8233-b64cb9a3ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Flow 'volume_create_manager' (7cd39b00-32a0-454a-9f5a-bd9300c2b675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:40 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5a17ba54-2de7-4759-9bcb-1c94b9b541de tempest-GroupSnapshotsTest-1956636196 None] Created volume successfully. Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:40 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:18:40 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:40 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df Jun 25 18:18:40 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:41 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.022s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:18:41 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-69ab59f8-9a0e-4d93-b553-c22458811f66 req-68a11a74-3fa4-45d6-84fd-d035aa75dcb8 tempest-AttachVolumeTestJSON-1045690878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df" returned: 0 in 1.182s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-69ab59f8-9a0e-4d93-b553-c22458811f66 req-68a11a74-3fa4-45d6-84fd-d035aa75dcb8 tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.228s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-69ab59f8-9a0e-4d93-b553-c22458811f66 req-68a11a74-3fa4-45d6-84fd-d035aa75dcb8 tempest-AttachVolumeTestJSON-1045690878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-18b59043-909b-4287-b5ae-df5783fb50df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbc3a149-2d16-40e6-a5d0-b81d75760792', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:18:41 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-69ab59f8-9a0e-4d93-b553-c22458811f66 req-68a11a74-3fa4-45d6-84fd-d035aa75dcb8 tempest-AttachVolumeTestJSON-1045690878 None] attachment_update completed successfully. Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Flow 'volume_create_manager' (fe15512d-3727-4f13-8180-e8551f5afd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77cd70a-028a-41d1-877f-65f725d9bae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77cd70a-028a-41d1-877f-65f725d9bae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35099424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2073422-5e70-4207-bceb-0e975f1861e7,host='devstack@QuobyteHD#QuobyteHD',id=1d31d297-bf1c-40e2-a4b0-a6c89df1dd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097751983a474b28b6656f85dd52710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:42Z,use_quota=True,user_id='e239702e5a7b4cd7ba08cd159c9492d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4cba782-df28-4c19-8d3d-1194458a54ea),volume_type_id=c4cba782-df28-4c19-8d3d-1194458a54ea)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff181b7-b7a8-4ac1-acc2-890e78144fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff181b7-b7a8-4ac1-acc2-890e78144fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce4bbfc-4b5d-4520-9b41-3520d1d8ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce4bbfc-4b5d-4520-9b41-3520d1d8ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d31d297-bf1c-40e2-a4b0-a6c89df1dd76', 'volume_name': 'volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630e1572-c7d6-45ab-bb97-42f7d85b0e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630e1572-c7d6-45ab-bb97-42f7d85b0e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc425e9-8de2-423d-9d7b-36f2e597f803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:42 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Volume 1d31d297-bf1c-40e2-a4b0-a6c89df1dd76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76', 'volume_size': 1} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e2073422-5e70-4207-bceb-0e975f1861e7,created_at=2026-06-25T16:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35099424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2073422-5e70-4207-bceb-0e975f1861e7,host='devstack@QuobyteHD#QuobyteHD',id=1d31d297-bf1c-40e2-a4b0-a6c89df1dd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097751983a474b28b6656f85dd52710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:42Z,use_quota=True,user_id='e239702e5a7b4cd7ba08cd159c9492d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4cba782-df28-4c19-8d3d-1194458a54ea),volume_type_id=c4cba782-df28-4c19-8d3d-1194458a54ea)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Creating volume 1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:42 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:18:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:42 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 1073741824 Jun 25 18:18:42 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:43 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 1073741824" returned: 0 in 1.532s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:43 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 Jun 25 18:18:43 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:44 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" returned: 0 in 0.971s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] <== create_volume: return (2578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.582s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc425e9-8de2-423d-9d7b-36f2e597f803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eceaf24-3c62-4cb2-813d-d6ad949866de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:44 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Volume volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 (1d31d297-bf1c-40e2-a4b0-a6c89df1dd76): created successfully Jun 25 18:18:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eceaf24-3c62-4cb2-813d-d6ad949866de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Flow 'volume_create_manager' (fe15512d-3727-4f13-8180-e8551f5afd34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2dc2abdf-5087-48d4-a141-10c7aa37177b tempest-GroupSnapshotsTest-1956636196 None] Created volume successfully. Jun 25 18:18:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-714b0887-2548-4181-802c-88e37091c53e tempest-GroupSnapshotsTest-1956636196 None] Update group completed successfully. Jun 25 18:18:47 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-554476ca-a3fe-4c27-bfe5-8d8e75996663 tempest-GroupSnapshotsTest-1956636196 None] Update group completed successfully. Jun 25 18:18:48 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c673e4a6-61cb-4b7c-8edd-76294a5847a9 tempest-GroupSnapshotsTest-1956636196 None] Update group completed successfully. Jun 25 18:18:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:49 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cca73d-8d56-44fe-9eeb-83d4631d9041]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:49 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:18:49 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:49 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-cf2ff841-7ced-4f13-bebf-16233b833a1f tempest-GroupSnapshotsTest-1956636196 None] Update group completed successfully. Jun 25 18:18:50 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 0 in 1.296s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:50 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:18:50 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] GroupSnapshot 5c5fc05c-e1c0-4c37-9364-e57055ca47c3: creating. Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Group snapshot 5c5fc05c-e1c0-4c37-9364-e57055ca47c3: creating. {{(pid=93767) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4755}} Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:51 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 1 in 0.903s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.245s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.180s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Creating offline snapshot 44ded40d-e334-4dcf-9bc4-000b1afec556 of volume 1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e322f9f5-c3e4-42a9-b4e4-ac05bdf4f195]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9409f895-402b-4b26-abf9-9e773dc1da17', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:18:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-cc32c99f-50aa-44b8-8b99-a9edc49721c8 req-712eb33e-9a49-4686-901c-4c39bbfabb61 tempest-TestShelveInstance-799047132 None] attachment_update completed successfully. Jun 25 18:18:51 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 Jun 25 18:18:51 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Flow 'volume_create_manager' (4e9cb434-5f75-4cf4-9a0f-73c6cbde4739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17689bbd-b9d9-482e-ad68-b971baa5e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17689bbd-b9d9-482e-ad68-b971baa5e72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1089580035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ccd31c-d3e8-4db9-aa24-faee4dd9537d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bb30d5171d437d805d2879223dcc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:52Z,use_quota=True,user_id='d3e1162acca04d85b5164e436d47124f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e06cf35a-b97b-4d4b-94d2-caaca5425f59),volume_type_id=e06cf35a-b97b-4d4b-94d2-caaca5425f59)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb05118-559c-4812-9035-d0728329d995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb05118-559c-4812-9035-d0728329d995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af84c44-f8bc-417a-937d-aa266b2b7ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af84c44-f8bc-417a-937d-aa266b2b7ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ccd31c-d3e8-4db9-aa24-faee4dd9537d', 'volume_name': 'volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555f9dc0-c7b5-4652-8485-3288ec23a8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555f9dc0-c7b5-4652-8485-3288ec23a8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede8a499-0542-421d-b2cd-74df43ca96ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:52 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Volume 93ccd31c-d3e8-4db9-aa24-faee4dd9537d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d', 'volume_size': 1} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:52 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" returned: 0 in 1.247s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:52 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 1G Jun 25 18:18:52 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Flow 'volume_create_manager' (8659fc8b-fca7-403c-ba45-4a9b57eae90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b732eee3-50e9-4bb0-b1d6-034a373ac7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b732eee3-50e9-4bb0-b1d6-034a373ac7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1014130126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c3925f-8d15-4ada-aa84-9fe253e9c9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bb30d5171d437d805d2879223dcc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:53Z,use_quota=True,user_id='d3e1162acca04d85b5164e436d47124f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49f4ef81-7883-475a-9f31-ae2b75615ddd),volume_type_id=49f4ef81-7883-475a-9f31-ae2b75615ddd)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994e662a-8a7f-4bce-89b7-94ecf29febab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994e662a-8a7f-4bce-89b7-94ecf29febab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa66cec-629f-4662-8f7e-e70ee017ecfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa66cec-629f-4662-8f7e-e70ee017ecfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c3925f-8d15-4ada-aa84-9fe253e9c9b7', 'volume_name': 'volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93577352-09cc-46ec-9f48-87697ee54b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93577352-09cc-46ec-9f48-87697ee54b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9065d497-f528-4030-8f28-380810281537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:53 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Volume c3c3925f-8d15-4ada-aa84-9fe253e9c9b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7', 'volume_size': 1} Jun 25 18:18:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Flow 'volume_create_manager' (8a972c77-3e11-44bb-89cd-fcbe86ad3720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebdf585-2ea0-4f7f-ac5f-28f4a7f6de72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebdf585-2ea0-4f7f-ac5f-28f4a7f6de72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1794760321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424be698-7e2b-4e57-a987-2e841318f461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bb30d5171d437d805d2879223dcc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:54Z,use_quota=True,user_id='d3e1162acca04d85b5164e436d47124f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d31eba6b-7f81-4ac5-b64b-f0d5509830ba),volume_type_id=d31eba6b-7f81-4ac5-b64b-f0d5509830ba)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f765210-d0e5-4189-a46a-6c6f4287f9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f765210-d0e5-4189-a46a-6c6f4287f9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c057d584-b8d7-4871-be9a-279bad7915e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.image.glance [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Creating Keystone auth plugin from conf {{(pid=93767) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:18:54 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 1G" returned: 0 in 1.239s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:54 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 Jun 25 18:18:54 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c057d584-b8d7-4871-be9a-279bad7915e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '424be698-7e2b-4e57-a987-2e841318f461', 'volume_name': 'volume-424be698-7e2b-4e57-a987-2e841318f461', 'volume_size': 1, 'image_id': '00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2001878095', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c1bb30d5171d437d805d2879223dcc15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'created_at': datetime.datetime(2026, 6, 25, 16, 18, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6/file', 'properties': {}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31979d3-fefa-47b0-8cf7-7f33db1f3467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31979d3-fefa-47b0-8cf7-7f33db1f3467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dcddff-31ed-4c88-afdd-e67c1916653a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:54 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Volume 424be698-7e2b-4e57-a987-2e841318f461: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-424be698-7e2b-4e57-a987-2e841318f461', 'volume_size': 1, 'image_id': '00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2001878095', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c1bb30d5171d437d805d2879223dcc15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'created_at': datetime.datetime(2026, 6, 25, 16, 18, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6/file', 'properties': {}}, 'image_service': } Jun 25 18:18:54 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Trying to clone 424be698-7e2b-4e57-a987-2e841318f461 from image 00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'metadata': {}}]). {{(pid=93767) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:18:55 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556" returned: 0 in 0.845s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:55 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:18:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:55 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 Jun 25 18:18:55 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:55 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556" returned: 0 in 0.702s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:55 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.info Jun 25 18:18:55 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:56 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.info" returned: 0 in 0.777s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:56 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:18:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:56 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.info Jun 25 18:18:56 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:57 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.info" returned: 0 in 0.807s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.739s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Creating offline snapshot baf9d3f1-098e-4d3a-9576-80814e0d41df of volume 6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:18:57 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9436e37-dc33-4312-9bf9-e6903663996b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:57 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 Jun 25 18:18:57 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:58 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" returned: 0 in 1.376s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:58 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df 1G Jun 25 18:18:58 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:59 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD, size 20.69 MB, duration 4.64 sec {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:18:59 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Image download 20.69 MB at 4.46 MB/s Jun 25 18:18:59 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8bb50-d3d1-443e-bb61-66b907c4f31f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:59 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD Jun 25 18:18:59 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:59 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df 1G" returned: 0 in 1.213s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:00 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df Jun 25 18:19:00 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:00 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD" returned: 0 in 0.964s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:00 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Temporary image 00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6 is fetched for user d3e1162acca04d85b5164e436d47124f. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:19:00 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bdda0a-f567-462c-a2ec-ad59d5ad3050]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:00 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD Jun 25 18:19:00 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:01 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df" returned: 0 in 1.254s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:01 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:19:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:01 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df Jun 25 18:19:01 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:01 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD" returned: 0 in 1.585s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:02 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df" returned: 0 in 1.730s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:03 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.info Jun 25 18:19:03 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:04 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.info" returned: 0 in 1.693s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:04 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:19:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:04 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.info Jun 25 18:19:04 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:07 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.info" returned: 0 in 2.384s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.819s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.734s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1014130126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c3925f-8d15-4ada-aa84-9fe253e9c9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bb30d5171d437d805d2879223dcc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:53Z,use_quota=True,user_id='d3e1162acca04d85b5164e436d47124f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49f4ef81-7883-475a-9f31-ae2b75615ddd),volume_type_id=49f4ef81-7883-475a-9f31-ae2b75615ddd)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Creating volume c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:19:07 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:19:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:07 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 1073741824 Jun 25 18:19:07 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:07 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1e2cabee-37e1-4402-a455-327359d37e39 tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 5c5fc05c-e1c0-4c37-9364-e57055ca47c3: created successfully Jun 25 18:19:08 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 5c5fc05c-e1c0-4c37-9364-e57055ca47c3: deleting Jun 25 18:19:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 5c5fc05c-e1c0-4c37-9364-e57055ca47c3: deleting {{(pid=93767) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4930}} Jun 25 18:19:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-44ded40d-e334-4dcf-9bc4-000b1afec556" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-44ded40d-e334-4dcf-9bc4-000b1afec556" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Deleting offline snapshot 44ded40d-e334-4dcf-9bc4-000b1afec556 of volume 1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:19:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] snapshot_file for this snap is: volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:19:09 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef077e1-a49b-4f6e-9c12-3a309f487f05]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:09 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 Jun 25 18:19:09 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:09 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 1073741824" returned: 0 in 2.681s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:09 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 Jun 25 18:19:09 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:10 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556" returned: 0 in 1.209s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:19:10 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7046460-e815-4885-b6aa-0121bde32f7c]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:10 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 Jun 25 18:19:10 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:11 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7" returned: 0 in 1.132s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] <== create_volume: return (3879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.883s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.456s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1089580035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ccd31c-d3e8-4db9-aa24-faee4dd9537d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bb30d5171d437d805d2879223dcc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:52Z,use_quota=True,user_id='d3e1162acca04d85b5164e436d47124f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e06cf35a-b97b-4d4b-94d2-caaca5425f59),volume_type_id=e06cf35a-b97b-4d4b-94d2-caaca5425f59)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Creating volume 93ccd31c-d3e8-4db9-aa24-faee4dd9537d {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:19:11 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:11 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d 1073741824 Jun 25 18:19:11 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9065d497-f528-4030-8f28-380810281537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8edabe-1197-433c-a254-0b75844ebe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:11 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Volume volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 (c3c3925f-8d15-4ada-aa84-9fe253e9c9b7): created successfully Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8edabe-1197-433c-a254-0b75844ebe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Flow 'volume_create_manager' (8659fc8b-fca7-403c-ba45-4a9b57eae90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:19:11 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9c03031d-91e5-4f82-a4af-b919c0f31658 tempest-TestInstancesWithCinderVolumes-1170378554 None] Created volume successfully. Jun 25 18:19:11 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" returned: 0 in 1.391s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:11 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 Jun 25 18:19:11 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:12 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d 1073741824" returned: 0 in 0.924s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:12 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d Jun 25 18:19:12 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:12 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556" returned: 0 in 1.063s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:12 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556 Jun 25 18:19:12 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:12 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d" returned: 0 in 0.841s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.088s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1794760321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424be698-7e2b-4e57-a987-2e841318f461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bb30d5171d437d805d2879223dcc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:54Z,use_quota=True,user_id='d3e1162acca04d85b5164e436d47124f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d31eba6b-7f81-4ac5-b64b-f0d5509830ba),volume_type_id=d31eba6b-7f81-4ac5-b64b-f0d5509830ba)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Creating volume 424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:19:12 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:19:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede8a499-0542-421d-b2cd-74df43ca96ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:13 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 1073741824 Jun 25 18:19:13 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59042647-45ff-48c1-b326-68e82319eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:13 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Volume volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d (93ccd31c-d3e8-4db9-aa24-faee4dd9537d): created successfully Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59042647-45ff-48c1-b326-68e82319eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Flow 'volume_create_manager' (4e9cb434-5f75-4cf4-9a0f-73c6cbde4739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:19:13 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ef6c14af-1520-4b8e-8e4c-734ab1248e47 tempest-TestInstancesWithCinderVolumes-1170378554 None] Created volume successfully. Jun 25 18:19:13 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76.44ded40d-e334-4dcf-9bc4-000b1afec556" returned: 0 in 1.065s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-44ded40d-e334-4dcf-9bc4-000b1afec556" released by "_delete_snapshot" :: held 4.933s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" released by "delete_snapshot" :: held 4.992s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-baf9d3f1-098e-4d3a-9576-80814e0d41df" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-baf9d3f1-098e-4d3a-9576-80814e0d41df" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Deleting offline snapshot baf9d3f1-098e-4d3a-9576-80814e0d41df of volume 6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] snapshot_file for this snap is: volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74f04cc-69b8-4b63-aeb1-23420d70e0de]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:14 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df Jun 25 18:19:14 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:14 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 1073741824" returned: 0 in 1.294s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:14 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 Jun 25 18:19:14 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:15 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df" returned: 0 in 1.078s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e981e85-8e30-4845-b3c7-7c1e03c8bc86]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:15 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461" returned: 0 in 0.830s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] <== create_volume: return (2182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Attempting download of 00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'metadata': {}}])) to volume 424be698-7e2b-4e57-a987-2e841318f461. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:19:15 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 Jun 25 18:19:15 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a08b978-c3bd-4d40-9ea9-6399c7b7bfbb]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_bei6d7y1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:15 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_bei6d7y1 Jun 25 18:19:15 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:16 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" returned: 0 in 0.902s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:16 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df Jun 25 18:19:16 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:16 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_bei6d7y1" returned: 0 in 1.025s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_bei6d7y1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:16 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_bei6d7y1 Jun 25 18:19:16 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:17 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df" returned: 0 in 1.146s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:17 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df Jun 25 18:19:17 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:17 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_bei6d7y1" returned: 1 in 0.935s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_bei6d7y1' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:19:17 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb6c5d4-cc5f-49d0-98c0-61bcc37375e3]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:17 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD Jun 25 18:19:17 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:17 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24.baf9d3f1-098e-4d3a-9576-80814e0d41df" returned: 0 in 0.806s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-baf9d3f1-098e-4d3a-9576-80814e0d41df" released by "_delete_snapshot" :: held 4.060s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" released by "delete_snapshot" :: held 4.103s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:18 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=70,cinder:SELECT=70,cinder:INSERT=19,cinder:DELETE=4 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:19:18 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=89,cinder:UPDATE=57,cinder:INSERT=18,cinder:DELETE=2 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:19:18 devstack cinder-volume[93767]: WARNING cinder.quota [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-484117434 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-484117434, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:19:18 devstack cinder-volume[93767]: WARNING cinder.quota [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-484117434 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-484117434, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:19:18 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['c7f58e9c-a5b5-44d2-ac0c-0952444193be', '7d62e1f8-4a93-4b17-beb3-db5f2223bf4a', 'e0b0f3eb-6b59-4d73-a5b9-de2a9e3582bd', 'fe445fe9-e7aa-4c3e-b617-dee8bfd29f55'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:18 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD" returned: 0 in 1.067s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:18 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] 00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6 was qcow2, converting to raw {{(pid=93767) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:19:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:18 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 Jun 25 18:19:18 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:18 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['218a8d61-8bf4-49d7-a024-8456a1064754', '41c4a655-39d8-4b15-90c9-1b41d1d176f6', 'ead4a3a9-f024-4b28-8057-e4e9016c835d', '97f0e623-6376-4519-8459-4379e0e3ae54'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4dab466a-83cb-4df0-99ac-e188bc917bcc tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 5c5fc05c-e1c0-4c37-9364-e57055ca47c3: deleted successfully Jun 25 18:19:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:20 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6e332d-e976-4760-bf53-4db20b1343db]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:20 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 Jun 25 18:19:20 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:20 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" returned: 0 in 0.898s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:20 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76 Jun 25 18:19:20 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:21 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461" returned: 0 in 2.917s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:21 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6_aiv5fcrydevstack@QuobyteHD, size 112.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:19:21 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Converted 112.00 MB image at 38.38 MB/s Jun 25 18:19:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:21 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 1G Jun 25 18:19:21 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:21 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" returned: 0 in 0.726s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-1d31d297-bf1c-40e2-a4b0-a6c89df1dd76" released by "delete_volume" :: held 1.763s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" acquired by "delete_volume" :: waited 0.015s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:21 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[801063d3-450d-4069-9833-a3cd845b7212]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:21 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 Jun 25 18:19:21 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:21 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 1G" returned: 0 in 0.696s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2788b6-9229-469f-96e3-e05549e6ea37]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:22 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 Jun 25 18:19:22 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:22 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" returned: 0 in 0.807s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:22 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24 Jun 25 18:19:22 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:22 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461" returned: 0 in 0.805s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:22 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 Jun 25 18:19:22 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:23 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" returned: 0 in 0.665s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-6d16d8fc-ed36-4625-b7a2-7e9c93c77f24" released by "delete_volume" :: held 1.534s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['68ea3cc1-f8b5-42b6-9c62-74ca273fa4e5'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:23 devstack cinder-volume[93767]: WARNING cinder.quota [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-484117434 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-484117434, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['51cb822c-616b-43ee-8a0b-9960fb933e8e', '0695c819-1d75-4ffe-b201-fb76d0dab23e', '45f25fcc-7ca5-464e-864e-51eee7600ef4', 'aa30c1ce-7e42-4b28-a0e6-bff9ebce5497'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['14aba0eb-e8ad-42a6-9517-dc316f4dc8e9', 'a60d8b8f-cbe9-48c7-8716-292aa56368ff', '60fdd7ed-9ec4-4d11-9071-9022be5c183b', '8410daf2-8cfd-4193-80d5-e7c2d4f7d4ad'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:23 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:19:23 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:23 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461" returned: 1 in 0.832s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Downloaded image 00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'metadata': {}}])) to volume 424be698-7e2b-4e57-a987-2e841318f461 successfully. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Temporary image 00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6 for user d3e1162acca04d85b5164e436d47124f is deleted. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Marking volume 424be698-7e2b-4e57-a987-2e841318f461 as bootable. {{(pid=93767) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Copying metadata from image 00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6 to 424be698-7e2b-4e57-a987-2e841318f461. {{(pid=93767) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Creating volume glance metadata for volume 424be698-7e2b-4e57-a987-2e841318f461 backed by image 00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6 with: {'image_id': '00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'image_name': 'tempest-scenario-img--2001878095', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93767) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dcddff-31ed-4c88-afdd-e67c1916653a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-424be698-7e2b-4e57-a987-2e841318f461', 'volume_size': 1, 'image_id': '00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2001878095', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c1bb30d5171d437d805d2879223dcc15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6', 'created_at': datetime.datetime(2026, 6, 25, 16, 18, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a3f0cf-9a38-4e34-bb47-4a05ec2f11a6/file', 'properties': {}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707de325-91d0-426f-938b-12eee0b70cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:23 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Volume volume-424be698-7e2b-4e57-a987-2e841318f461 (424be698-7e2b-4e57-a987-2e841318f461): created successfully Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707de325-91d0-426f-938b-12eee0b70cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:23 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Flow 'volume_create_manager' (8a972c77-3e11-44bb-89cd-fcbe86ad3720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:19:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0e9573df-57a9-4920-a964-64a59e8c3695 tempest-TestInstancesWithCinderVolumes-1170378554 None] Created volume successfully. Jun 25 18:19:24 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.637s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:24 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:19:24 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-46641cf3-8071-4a97-a5e9-48b4fcbdb3b0 tempest-GroupSnapshotsTest-1956636196 None] Delete group completed successfully. Jun 25 18:19:25 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4034d90f-60a3-4ed0-9091-0d625f33b6ee tempest-GroupSnapshotsTest-1956636196 None] Group tempest-GroupSnapshotsTest-Group-1071473741: creating Jun 25 18:19:25 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4034d90f-60a3-4ed0-9091-0d625f33b6ee tempest-GroupSnapshotsTest-1956636196 None] Group tempest-GroupSnapshotsTest-Group-1071473741: created successfully Jun 25 18:19:25 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4034d90f-60a3-4ed0-9091-0d625f33b6ee tempest-GroupSnapshotsTest-1956636196 None] Create group completed successfully. Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Flow 'volume_create_manager' (c27c87ca-0611-488c-84d3-1d5c486dd039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37e1ca7-3585-4706-8c44-d837148cca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37e1ca7-3585-4706-8c44-d837148cca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-222510593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1af8f397-16a4-49c8-96b8-fff77a2f9dc4,host='devstack@QuobyteHD#QuobyteHD',id=ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097751983a474b28b6656f85dd52710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:19:27Z,use_quota=True,user_id='e239702e5a7b4cd7ba08cd159c9492d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48bb6c77-31d4-40bc-912f-ffcc39ecde15),volume_type_id=48bb6c77-31d4-40bc-912f-ffcc39ecde15)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d0338a-1017-4ec8-8769-177b78b4b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d0338a-1017-4ec8-8769-177b78b4b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c82f251-00cb-46af-bb4c-4db15a515a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c82f251-00cb-46af-bb4c-4db15a515a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc', 'volume_name': 'volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a821e79-532f-419c-b46b-5fb24180c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a821e79-532f-419c-b46b-5fb24180c784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186f7cf5-c65d-4444-a4a4-fd6166ecef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:26 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Volume ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc', 'volume_size': 1} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1af8f397-16a4-49c8-96b8-fff77a2f9dc4,created_at=2026-06-25T16:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-222510593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1af8f397-16a4-49c8-96b8-fff77a2f9dc4,host='devstack@QuobyteHD#QuobyteHD',id=ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097751983a474b28b6656f85dd52710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:19:27Z,use_quota=True,user_id='e239702e5a7b4cd7ba08cd159c9492d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48bb6c77-31d4-40bc-912f-ffcc39ecde15),volume_type_id=48bb6c77-31d4-40bc-912f-ffcc39ecde15)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Creating volume ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:19:26 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:19:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:26 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc 1073741824 Jun 25 18:19:26 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:27 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc 1073741824" returned: 0 in 1.059s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:27 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc Jun 25 18:19:28 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:28 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" returned: 0 in 0.818s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:19:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186f7cf5-c65d-4444-a4a4-fd6166ecef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e03146-8f7b-4e1c-abea-d5d2f0862bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:28 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Volume volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc (ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc): created successfully Jun 25 18:19:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e03146-8f7b-4e1c-abea-d5d2f0862bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Flow 'volume_create_manager' (c27c87ca-0611-488c-84d3-1d5c486dd039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:19:28 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c6d880c0-33d4-43dc-899a-f34e6ceda728 tempest-GroupSnapshotsTest-1956636196 None] Created volume successfully. Jun 25 18:19:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] GroupSnapshot 73fd6ca8-051e-420e-b4f1-2c5cfc60ffe8: creating. Jun 25 18:19:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Group snapshot 73fd6ca8-051e-420e-b4f1-2c5cfc60ffe8: creating. {{(pid=93767) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4755}} Jun 25 18:19:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Creating offline snapshot eadcab43-d2a1-4676-852a-6258216b02d8 of volume ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:19:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e9624-2725-490a-b21c-e4523190eb38]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:29 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc Jun 25 18:19:29 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:30 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" returned: 0 in 1.198s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:30 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 1G Jun 25 18:19:30 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-3217e16e-4a49-4596-846b-0355c35d4bbc req-d69a6bf0-1c81-46fd-a775-6df98fd8843c tempest-AttachVolumeTestJSON-1045690878 None] Terminate volume connection completed successfully. Jun 25 18:19:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-3217e16e-4a49-4596-846b-0355c35d4bbc req-d69a6bf0-1c81-46fd-a775-6df98fd8843c tempest-AttachVolumeTestJSON-1045690878 None] Deleting attachment fbc3a149-2d16-40e6-a5d0-b81d75760792. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:19:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:32 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 1G" returned: 0 in 1.550s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:32 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 Jun 25 18:19:32 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:33 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8" returned: 0 in 0.999s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:33 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:19:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:33 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 Jun 25 18:19:33 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:34 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8" returned: 0 in 0.896s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:34 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.info Jun 25 18:19:34 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:35 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.info" returned: 0 in 1.120s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:35 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:19:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:35 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.info Jun 25 18:19:35 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:36 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.info" returned: 0 in 0.828s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.712s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.170s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:36 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c363d27c-7e7a-41e0-8e0f-b2b44a1f40b3]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:36 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b83cc0c9-bd91-431c-8549-45aeca488b85 tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 73fd6ca8-051e-420e-b4f1-2c5cfc60ffe8: created successfully Jun 25 18:19:36 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 Jun 25 18:19:36 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 73fd6ca8-051e-420e-b4f1-2c5cfc60ffe8: deleting Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 73fd6ca8-051e-420e-b4f1-2c5cfc60ffe8: deleting {{(pid=93767) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4930}} Jun 25 18:19:37 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461" returned: 0 in 0.903s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-eadcab43-d2a1-4676-852a-6258216b02d8" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-eadcab43-d2a1-4676-852a-6258216b02d8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Deleting offline snapshot eadcab43-d2a1-4676-852a-6258216b02d8 of volume ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] snapshot_file for this snap is: volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d34832-ca60-43b0-b2c7-d0f0fa65615c]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:37 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 Jun 25 18:19:37 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:37 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 Jun 25 18:19:37 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:38 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461" returned: 1 in 0.964s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:19:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.915s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-424be698-7e2b-4e57-a987-2e841318f461', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a70faa1c-80b0-4ed6-a136-808844a78e2c', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:19:38 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-4a70a005-0a98-49aa-b550-13fa11c6201e req-34c71a90-ce10-4828-b1b2-e39a4850db17 tempest-TestInstancesWithCinderVolumes-1170378554 None] attachment_update completed successfully. Jun 25 18:19:38 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8" returned: 0 in 1.035s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:19:38 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f6e28e-a879-49d2-a73e-b477860f226a]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:38 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc Jun 25 18:19:38 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-912d4e94-ae45-42ea-b0f4-acb114a67686 req-bd35b021-0032-49a7-bef0-d5742f0c98eb tempest-TestShelveInstance-799047132 None] Terminate volume connection completed successfully. Jun 25 18:19:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-912d4e94-ae45-42ea-b0f4-acb114a67686 req-bd35b021-0032-49a7-bef0-d5742f0c98eb tempest-TestShelveInstance-799047132 None] Deleting attachment 9409f895-402b-4b26-abf9-9e773dc1da17. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:19:39 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" returned: 0 in 0.898s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:39 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 Jun 25 18:19:39 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:40 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8" returned: 0 in 0.775s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:40 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8 Jun 25 18:19:40 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:40 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:19:40 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:40 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc.eadcab43-d2a1-4676-852a-6258216b02d8" returned: 0 in 0.783s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-eadcab43-d2a1-4676-852a-6258216b02d8" released by "_delete_snapshot" :: held 3.690s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" released by "delete_snapshot" :: held 3.725s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:41 devstack cinder-volume[93767]: WARNING cinder.quota [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-986213107 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-986213107, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:19:41 devstack cinder-volume[93767]: WARNING cinder.quota [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-986213107 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-986213107, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:19:41 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['3d6de7d4-5dd3-4c7e-ad4b-4335907d2145', 'dc9be43a-54a2-43ed-a7c6-7c878d0382a1', 'e0e69863-c82f-4a0f-a342-fc5d8bac3ace', '115a4f07-7bf5-419a-bdfa-70c32986108c'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:41 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f380c898-162b-4600-879b-3da35b10b110 tempest-GroupSnapshotsTest-1956636196 None] group_snapshot 73fd6ca8-051e-420e-b4f1-2c5cfc60ffe8: deleted successfully Jun 25 18:19:41 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.814s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:19:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:19:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:19:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:19:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "cinder-quobyte-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:42 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebac8713-ae30-4945-8a9f-a6af5e78718f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:42 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc Jun 25 18:19:42 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:42 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" returned: 0 in 0.817s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:42 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc Jun 25 18:19:42 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:43 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" returned: 0 in 0.751s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:43 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Lock "cinder-quobyte-ce7f0ea9-1e5e-462f-bfdb-d73fa96de2fc" released by "delete_volume" :: held 1.665s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:43 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374710a-b45a-4f47-9196-7b2fb0f35153]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:43 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['6c3547cf-b3be-4410-95cf-2eb24d258a8c'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:43 devstack cinder-volume[93767]: WARNING cinder.quota [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-986213107 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-986213107, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:19:43 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Created reservations ['1f2ae671-3b2d-4548-9141-0bbc4d22bd60', '8a0b5dd8-ba46-43d5-a65d-37d7e4901583', 'fbbbb8aa-31e0-4acd-8336-cdd031fe1554', 'f2bfd1a1-d368-426e-9fd5-114970b4971f'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:43 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:19:43 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:44 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:19:44 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:45 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 0 in 1.808s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:45 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.665s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:45 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:19:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-84f6a58a-f2dc-4c74-8e5e-e5aee1c1f50a tempest-GroupSnapshotsTest-1956636196 None] Delete group completed successfully. Jun 25 18:19:45 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:19:45 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:47 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 1 in 1.834s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:19:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.703s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f46b90a5-ffca-4fe5-a6d8-26793e941e28', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:19:47 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-96f13f14-a8df-42c8-8426-71493ceeaaf0 req-6b4e48c6-5df6-41ae-908a-5ebad99ef592 tempest-TestShelveInstance-799047132 None] attachment_update completed successfully. Jun 25 18:19:57 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=59,cinder:INSERT=19,cinder:UPDATE=53 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:19:57 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=70,cinder:UPDATE=63,cinder:INSERT=17,cinder:DELETE=2 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Flow 'volume_create_manager' (3234b078-3b24-46fb-9656-c237a55d9785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf64846a-75ee-4692-800a-70148f99f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf64846a-75ee-4692-800a-70148f99f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-915672619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86df117-eb5a-4c39-a1f9-ca374db54528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca2b1322177411dae70d0d80a4f6153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:20:06Z,use_quota=True,user_id='3c9fe72e0f8a4b0b9d0c2a6d1b4d928e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f29af0c-4234-4711-9f96-0f6c7e74efe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f29af0c-4234-4711-9f96-0f6c7e74efe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab51df9-060a-421c-9875-48e6d54670f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab51df9-060a-421c-9875-48e6d54670f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86df117-eb5a-4c39-a1f9-ca374db54528', 'volume_name': 'volume-a86df117-eb5a-4c39-a1f9-ca374db54528', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b22fcb8-1ded-4d30-9a49-b3778ee4bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b22fcb8-1ded-4d30-9a49-b3778ee4bedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996f4c75-1b40-4db0-a291-a6c0d3ba02ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:05 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Volume a86df117-eb5a-4c39-a1f9-ca374db54528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86df117-eb5a-4c39-a1f9-ca374db54528', 'volume_size': 1} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-915672619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86df117-eb5a-4c39-a1f9-ca374db54528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca2b1322177411dae70d0d80a4f6153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:20:06Z,use_quota=True,user_id='3c9fe72e0f8a4b0b9d0c2a6d1b4d928e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Creating volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:20:05 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:20:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:06 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 1073741824 Jun 25 18:20:06 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:07 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 1073741824" returned: 0 in 1.479s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:07 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 Jun 25 18:20:07 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:08 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528" returned: 0 in 0.840s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] <== create_volume: return (2394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:20:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996f4c75-1b40-4db0-a291-a6c0d3ba02ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86df117-eb5a-4c39-a1f9-ca374db54528', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5d3389-0287-43b2-a917-2be0e294544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:08 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Volume volume-a86df117-eb5a-4c39-a1f9-ca374db54528 (a86df117-eb5a-4c39-a1f9-ca374db54528): created successfully Jun 25 18:20:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5d3389-0287-43b2-a917-2be0e294544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Flow 'volume_create_manager' (3234b078-3b24-46fb-9656-c237a55d9785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:20:08 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f06cbf31-529f-4ced-8a80-44f64d741c69 tempest-SnapshotsActionsTest-1334981912 None] Created volume successfully. Jun 25 18:20:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Creating offline snapshot 7e5efe94-e0cb-4804-b529-ede4d9e66405 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:20:09 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d4de25-6771-4f9b-98fa-1c2170fd2e5c]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:09 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 Jun 25 18:20:09 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:10 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528" returned: 0 in 0.835s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:10 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 1G Jun 25 18:20:10 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:10 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 1G" returned: 0 in 0.847s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:10 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:10 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:11 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 0.869s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:11 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 is being set with open permissions: ugo+rw Jun 25 18:20:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:11 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:11 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:12 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 0.745s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:12 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.info Jun 25 18:20:12 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:13 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.info" returned: 0 in 0.680s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:13 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.info is being set with open permissions: ugo+rw Jun 25 18:20:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:13 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.info Jun 25 18:20:13 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:13 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.info" returned: 0 in 0.739s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.855s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:14 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9eaa67c6-bd20-47ec-8c9d-4195f212a75a tempest-SnapshotsActionsTest-1334981912 None] Create snapshot completed successfully Jun 25 18:20:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Creating offline snapshot 5029fbe1-d83d-419d-879f-bd5280731f95 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:20:14 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35bf5ce-f88c-41c7-b72c-8b9112440d5e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:15 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:15 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:15 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 0.784s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:15 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 1G Jun 25 18:20:15 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:16 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 1G" returned: 0 in 0.973s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:16 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 Jun 25 18:20:16 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:17 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95" returned: 0 in 0.875s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:17 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 is being set with open permissions: ugo+rw Jun 25 18:20:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:17 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 Jun 25 18:20:17 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:18 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95" returned: 0 in 0.718s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.470s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b504edd3-bbb4-46b0-828c-87ab12251471 tempest-SnapshotsActionsTest-1334981912 None] Create snapshot completed successfully Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-5029fbe1-d83d-419d-879f-bd5280731f95-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-5029fbe1-d83d-419d-879f-bd5280731f95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-quobyte-5029fbe1-d83d-419d-879f-bd5280731f95" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-5029fbe1-d83d-419d-879f-bd5280731f95" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Deleting offline snapshot 5029fbe1-d83d-419d-879f-bd5280731f95 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] snapshot_file for this snap is: volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d379d6-61d0-4cf8-8191-0325f60b2fb1]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:19 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 Jun 25 18:20:19 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-0dbc4cb3-9971-4b52-8faf-2b080d1a1bb8 req-0ca8ad12-3a25-424c-a870-a8aa5921c38b tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-0dbc4cb3-9971-4b52-8faf-2b080d1a1bb8 req-0ca8ad12-3a25-424c-a870-a8aa5921c38b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:20 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95" returned: 0 in 0.819s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:20 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3a3726-3c91-4536-b88d-ae2137ba4943]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-0dbc4cb3-9971-4b52-8faf-2b080d1a1bb8 req-0ca8ad12-3a25-424c-a870-a8aa5921c38b tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:20 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41d71ff-9422-4249-8e0f-c4fa65e3a001]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:20 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:20 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:20 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d Jun 25 18:20:20 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:21 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 0.867s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:21 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 Jun 25 18:20:21 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:21 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-0dbc4cb3-9971-4b52-8faf-2b080d1a1bb8 req-0ca8ad12-3a25-424c-a870-a8aa5921c38b tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d" returned: 0 in 0.941s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-0dbc4cb3-9971-4b52-8faf-2b080d1a1bb8 req-0ca8ad12-3a25-424c-a870-a8aa5921c38b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.972s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-0dbc4cb3-9971-4b52-8faf-2b080d1a1bb8 req-0ca8ad12-3a25-424c-a870-a8aa5921c38b tempest-TestInstancesWithCinderVolumes-1170378554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7ae2ba1-0a21-4e56-a988-cf860654876c', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:20:21 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-0dbc4cb3-9971-4b52-8faf-2b080d1a1bb8 req-0ca8ad12-3a25-424c-a870-a8aa5921c38b tempest-TestInstancesWithCinderVolumes-1170378554 None] attachment_update completed successfully. Jun 25 18:20:21 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95" returned: 0 in 0.906s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:21 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95 Jun 25 18:20:21 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:22 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.5029fbe1-d83d-419d-879f-bd5280731f95" returned: 0 in 0.700s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-5029fbe1-d83d-419d-879f-bd5280731f95" released by "_delete_snapshot" :: held 3.459s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" released by "delete_snapshot" :: held 3.491s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:22 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Created reservations ['31936dad-b31b-40ea-897a-6c1d2b750782', '495db0f0-538b-404a-84e2-c2e78959eb34', '4c43754f-65f0-4481-8c96-7d0e73b32a45', '5ff32d22-b055-4584-af2c-59928c8cf11e'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:20:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Delete snapshot completed successfully. Jun 25 18:20:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-6487f35c-713c-44d6-a82b-657979fc9ae5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-5029fbe1-d83d-419d-879f-bd5280731f95-delete_snapshot" released by "delete_snapshot" :: held 3.653s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Creating offline snapshot c90fb0f3-92c9-4411-8c35-22a21730fdc5 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:20:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6aede2-95b2-49bf-aa17-e8487af5c613]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:23 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:23 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:24 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 0.786s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:24 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 1G Jun 25 18:20:24 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:25 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 1G" returned: 0 in 0.905s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:25 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 Jun 25 18:20:25 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:26 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5" returned: 0 in 0.709s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:26 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 is being set with open permissions: ugo+rw Jun 25 18:20:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:26 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 Jun 25 18:20:26 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:26 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5" returned: 0 in 0.686s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.191s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:27 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4843f904-34ce-4160-b530-241e81f0d6bb tempest-SnapshotsActionsTest-1334981912 None] Create snapshot completed successfully Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-c90fb0f3-92c9-4411-8c35-22a21730fdc5-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-c90fb0f3-92c9-4411-8c35-22a21730fdc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-quobyte-c90fb0f3-92c9-4411-8c35-22a21730fdc5" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-c90fb0f3-92c9-4411-8c35-22a21730fdc5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Deleting offline snapshot c90fb0f3-92c9-4411-8c35-22a21730fdc5 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] snapshot_file for this snap is: volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b2232f-0e24-4aa6-a038-734b131549ca]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:28 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 Jun 25 18:20:28 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:29 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5" returned: 0 in 1.208s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bb84d2-f768-4379-b65f-5e838261ee37]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:29 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:29 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-a9ad3254-dd35-4a38-837a-43e8848d1b4e req-50a944fa-22b0-4165-8f68-666fa5ebbac8 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-a9ad3254-dd35-4a38-837a-43e8848d1b4e req-50a944fa-22b0-4165-8f68-666fa5ebbac8 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:30 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4565b3a5-7621-4c9b-8601-7dad2ef1494e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-a9ad3254-dd35-4a38-837a-43e8848d1b4e req-50a944fa-22b0-4165-8f68-666fa5ebbac8 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:30 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 Jun 25 18:20:30 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:30 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 1.030s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:30 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 Jun 25 18:20:30 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:31 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-a9ad3254-dd35-4a38-837a-43e8848d1b4e req-50a944fa-22b0-4165-8f68-666fa5ebbac8 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7" returned: 0 in 1.165s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-a9ad3254-dd35-4a38-837a-43e8848d1b4e req-50a944fa-22b0-4165-8f68-666fa5ebbac8 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.187s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-a9ad3254-dd35-4a38-837a-43e8848d1b4e req-50a944fa-22b0-4165-8f68-666fa5ebbac8 tempest-TestInstancesWithCinderVolumes-1170378554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66e9787b-52d0-49d3-8f09-a97b2bf893f0', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:20:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-a9ad3254-dd35-4a38-837a-43e8848d1b4e req-50a944fa-22b0-4165-8f68-666fa5ebbac8 tempest-TestInstancesWithCinderVolumes-1170378554 None] attachment_update completed successfully. Jun 25 18:20:31 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5" returned: 0 in 1.057s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:31 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5 Jun 25 18:20:31 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:32 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.c90fb0f3-92c9-4411-8c35-22a21730fdc5" returned: 0 in 0.712s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-c90fb0f3-92c9-4411-8c35-22a21730fdc5" released by "_delete_snapshot" :: held 4.161s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" released by "delete_snapshot" :: held 4.186s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:32 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Created reservations ['80b708d5-33da-4d31-a3e6-4160a5ab6a49', '9e7f614b-f575-4a84-be51-4f81772c0457', '43ea6154-6a92-4f40-b17c-1e99881efaec', '5363c4de-4745-4ebf-b435-587517cb6cd9'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:20:32 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Delete snapshot completed successfully. Jun 25 18:20:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f7fcb84e-681e-4a26-8246-4a07cd5943c8 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-c90fb0f3-92c9-4411-8c35-22a21730fdc5-delete_snapshot" released by "delete_snapshot" :: held 4.353s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Creating offline snapshot d8265939-0797-4584-80a4-36e7a9f5db53 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:20:33 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b5db4-5c4e-48ec-be02-97190f2fe486]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:33 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:33 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:34 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 0.787s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:34 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 1G Jun 25 18:20:34 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:35 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 1G" returned: 0 in 1.111s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:35 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 Jun 25 18:20:35 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:36 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53" returned: 0 in 0.915s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:36 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 is being set with open permissions: ugo+rw Jun 25 18:20:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:36 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 Jun 25 18:20:36 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:37 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53" returned: 0 in 0.762s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.721s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-24f49f93-8934-4405-9b66-50e9f89613d6 tempest-SnapshotsActionsTest-1334981912 None] Create snapshot completed successfully Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-d8265939-0797-4584-80a4-36e7a9f5db53-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-d8265939-0797-4584-80a4-36e7a9f5db53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-quobyte-d8265939-0797-4584-80a4-36e7a9f5db53" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-d8265939-0797-4584-80a4-36e7a9f5db53" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Deleting offline snapshot d8265939-0797-4584-80a4-36e7a9f5db53 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] snapshot_file for this snap is: volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[505994bd-7cdf-4b56-928c-93797820555d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:38 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 Jun 25 18:20:38 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:39 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53" returned: 0 in 1.058s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:39 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[17162c7e-6e26-4e42-8569-90537d90980f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:39 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:39 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:40 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 0.911s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:40 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 Jun 25 18:20:40 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:40 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:20:40 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:41 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.892s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:20:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:20:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:20:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:20:41 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53" returned: 0 in 1.318s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:41 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53 Jun 25 18:20:41 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:42 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-81ae91a7-7ea6-47ba-96e4-6d6959efdf7d req-e73e355b-e924-4f78-901b-7d8937dc78f9 tempest-TestInstancesWithCinderVolumes-1170378554 None] Terminate volume connection completed successfully. Jun 25 18:20:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-81ae91a7-7ea6-47ba-96e4-6d6959efdf7d req-e73e355b-e924-4f78-901b-7d8937dc78f9 tempest-TestInstancesWithCinderVolumes-1170378554 None] Deleting attachment f7ae2ba1-0a21-4e56-a988-cf860654876c. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:20:42 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.d8265939-0797-4584-80a4-36e7a9f5db53" returned: 0 in 0.856s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-d8265939-0797-4584-80a4-36e7a9f5db53" released by "_delete_snapshot" :: held 4.269s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" released by "delete_snapshot" :: held 4.300s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:42 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Created reservations ['d2a37e49-ef84-4c4e-bd80-36375c8352c5', '44f0d2a0-49c0-49cc-8554-64014ba124c4', 'c3db1f33-5c51-4fa8-a9b0-762351bf3a0a', 'd90050e3-7709-46fa-b1d2-0393fc8b2fa8'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:20:42 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Delete snapshot completed successfully. Jun 25 18:20:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b490841-c32f-4ebe-bdd9-2bb82f4b8da5 tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-d8265939-0797-4584-80a4-36e7a9f5db53-delete_snapshot" released by "delete_snapshot" :: held 4.496s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Creating offline snapshot 81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:20:43 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daf7512-474f-4a69-a281-2c99760a4051]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:44 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:44 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "cinder-93ccd31c-d3e8-4db9-aa24-faee4dd9537d-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-93ccd31c-d3e8-4db9-aa24-faee4dd9537d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "cinder-quobyte-93ccd31c-d3e8-4db9-aa24-faee4dd9537d" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-quobyte-93ccd31c-d3e8-4db9-aa24-faee4dd9537d" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:44 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[64403873-5c4c-4ac0-871f-986141c0bb38]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:44 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d Jun 25 18:20:44 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:45 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 1.030s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:45 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 1G Jun 25 18:20:45 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:45 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d" returned: 0 in 1.207s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:45 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d Jun 25 18:20:45 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:46 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 1G" returned: 0 in 1.643s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:46 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 Jun 25 18:20:46 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:46 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93ccd31c-d3e8-4db9-aa24-faee4dd9537d" returned: 0 in 1.247s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:46 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-quobyte-93ccd31c-d3e8-4db9-aa24-faee4dd9537d" released by "delete_volume" :: held 2.555s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:47 devstack cinder-volume[93767]: WARNING cinder.quota [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405408592-284612765 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405408592-284612765, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:20:47 devstack cinder-volume[93767]: WARNING cinder.quota [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405408592-284612765 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405408592-284612765, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:20:47 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Created reservations ['d430d740-a529-4036-b02d-5ae779845795', '26bf7466-491b-4054-922c-92a422b4bb9e', 'e5531d6c-5e9c-4dc4-a42e-5d40fc68323c', 'c563c387-3851-4261-b213-9e749e92b5de'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:20:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:47 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:20:47 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:49 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5" returned: 0 in 2.406s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:49 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 is being set with open permissions: ugo+rw Jun 25 18:20:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:49 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 Jun 25 18:20:49 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:49 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.879s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:49 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:20:49 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Deleted volume successfully. Jun 25 18:20:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-afb2c5e9-45ee-4e8d-80bb-1ebddfa2c983 tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-93ccd31c-d3e8-4db9-aa24-faee4dd9537d-delete_volume" released by "delete_volume" :: held 5.154s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:50 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5" returned: 0 in 1.064s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.267s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:50 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8728e7a4-62d7-47e0-82a6-7b067f19bf60 tempest-SnapshotsActionsTest-1334981912 None] Create snapshot completed successfully Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Acquiring lock "cinder-quobyte-81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Deleting offline snapshot 81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] snapshot_file for this snap is: volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff84ab3-4e7f-470b-84f2-bad61c2fda44]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:51 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 Jun 25 18:20:51 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:51 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5" returned: 0 in 1.031s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:52 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[61723de4-8d76-45ea-a735-88744fdcba61]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:52 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:52 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:52 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-63a9be41-e3cd-42ed-aaab-e8697e14aeb2 tempest-TestShelveInstance-799047132 None] Terminate volume connection completed successfully. Jun 25 18:20:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-63a9be41-e3cd-42ed-aaab-e8697e14aeb2 tempest-TestShelveInstance-799047132 None] Deleting attachment f46b90a5-ffca-4fe5-a6d8-26793e941e28. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:20:52 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-08436040-9a9b-4f51-bffa-9a187f246cf2 req-58638845-c1b6-4a10-b35c-6322ae0f9915 tempest-TestInstancesWithCinderVolumes-1170378554 None] Terminate volume connection completed successfully. Jun 25 18:20:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-08436040-9a9b-4f51-bffa-9a187f246cf2 req-58638845-c1b6-4a10-b35c-6322ae0f9915 tempest-TestInstancesWithCinderVolumes-1170378554 None] Deleting attachment 66e9787b-52d0-49d3-8f09-a97b2bf893f0. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:20:52 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 0.941s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:53 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 Jun 25 18:20:53 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Acquiring lock "cinder-d9cced3b-d65b-4ace-9f5d-a00494bf7112-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Lock "cinder-d9cced3b-d65b-4ace-9f5d-a00494bf7112-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Acquiring lock "cinder-quobyte-d9cced3b-d65b-4ace-9f5d-a00494bf7112" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Lock "cinder-quobyte-d9cced3b-d65b-4ace-9f5d-a00494bf7112" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:53 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5ba6cf-5c14-4c6b-92bb-3670bca3d579]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:53 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:20:53 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:54 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5" returned: 0 in 1.158s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:54 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5 Jun 25 18:20:54 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:54 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 0 in 0.994s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:54 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:20:54 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "cinder-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "cinder-quobyte-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-quobyte-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7" acquired by "delete_volume" :: waited 0.038s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a900d333-6558-4434-bbb0-f0bb5c39a2d9]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:55 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 Jun 25 18:20:55 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:55 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5" returned: 0 in 1.066s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5" released by "_delete_snapshot" :: held 4.368s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" released by "delete_snapshot" :: held 4.405s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Created reservations ['ea361205-1d46-4730-b9f8-2bb539189ebe', 'e2b90086-67e9-4659-89d1-1d486497d51f', '0a020dd3-2819-4435-b559-876d4711b476', '847d7bae-3c07-485e-8272-a169c9c9eb23'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:20:55 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Delete snapshot completed successfully. Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-19736b1f-6502-48a1-a26b-b99aedf4afec tempest-SnapshotsActionsTest-1414971018 None] Lock "cinder-81d1c6cd-10a2-4356-b9c5-89e9fd1ca6a5-delete_snapshot" released by "delete_snapshot" :: held 4.645s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:55 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 1 in 1.150s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:55 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112 Jun 25 18:20:55 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:55 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7" returned: 0 in 1.073s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:55 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7 Jun 25 18:20:55 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:56 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d9cced3b-d65b-4ace-9f5d-a00494bf7112" returned: 0 in 1.073s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:56 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Lock "cinder-quobyte-d9cced3b-d65b-4ace-9f5d-a00494bf7112" released by "delete_volume" :: held 3.356s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:56 devstack cinder-volume[93767]: DEBUG cinder.quota [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Created reservations ['247ed493-ab81-4cb1-a3e8-ec7234451210', 'e97c3264-ac3d-42da-be59-67a52fbce15f', '17597957-5096-4c7c-a7a6-f90e78301ef3', 'e592582a-db06-43b1-bb0e-a0a1d421487e'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "cinder-7e5efe94-e0cb-4804-b529-ede4d9e66405-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:57 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:20:57 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-7e5efe94-e0cb-4804-b529-ede4d9e66405-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "cinder-quobyte-7e5efe94-e0cb-4804-b529-ede4d9e66405" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:57 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7" returned: 0 in 1.380s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-quobyte-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7" released by "delete_volume" :: held 2.580s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-quobyte-7e5efe94-e0cb-4804-b529-ede4d9e66405" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Deleting offline snapshot 7e5efe94-e0cb-4804-b529-ede4d9e66405 of volume a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] snapshot_file for this snap is: volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cba4f18-badd-460d-aa7f-686931805c6e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=44,cinder:SELECT=70,cinder:DELETE=5,cinder:INSERT=12 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:20:57 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:20:57 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:57 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=51,cinder:INSERT=14,cinder:UPDATE=57,cinder:DELETE=2 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:20:57 devstack cinder-volume[93767]: WARNING cinder.quota [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-33373975-1352693950 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-33373975-1352693950, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:20:57 devstack cinder-volume[93767]: WARNING cinder.quota [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-33373975-1352693950 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-33373975-1352693950, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:20:58 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Created reservations ['44a1ea34-e1ca-4c33-acf5-18670974edf7', 'e2da4a92-e299-4357-93d6-8ce15699a6a4', 'e8f961d4-6683-457b-84fd-72e84d608bb3', '8ae488bb-f738-4f91-b34b-b61983c25763'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:20:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:58 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:20:58 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:59 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 2.264s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG cinder.manager [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:20:59 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Deleted volume successfully. Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [req-95760eda-2505-447e-9ab6-4a5678c6c778 req-0dd805a3-8dc7-4584-a8a7-154c3af89de4 tempest-TestShelveInstance-799047132 None] Lock "cinder-d9cced3b-d65b-4ace-9f5d-a00494bf7112-delete_volume" released by "delete_volume" :: held 6.249s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:59 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 2.052s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86df117-eb5a-4c39-a1f9-ca374db54528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e82234-9d4b-42a6-9524-f973c214208e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:59 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.401s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:20:59 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Deleted volume successfully. Jun 25 18:20:59 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 Jun 25 18:20:59 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d85dab47-c73e-4d87-9db8-6b96e6d3857b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-c3c3925f-8d15-4ada-aa84-9fe253e9c9b7-delete_volume" released by "delete_volume" :: held 5.260s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:01 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528" returned: 0 in 1.866s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:01 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:21:01 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:03 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 1.733s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:03 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405 Jun 25 18:21:03 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:04 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528.7e5efe94-e0cb-4804-b529-ede4d9e66405" returned: 0 in 1.197s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-quobyte-7e5efe94-e0cb-4804-b529-ede4d9e66405" released by "_delete_snapshot" :: held 7.166s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" released by "delete_snapshot" :: held 7.249s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:04 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Created reservations ['56410e73-b20f-446c-a22c-ea582a0a6e46', '49a7621c-d4b3-417f-a8d2-abd7cbab5f7f', '60a5cfaf-fc7e-4a4f-8172-69ad524fcbfc', '791d8037-b96d-4bd5-b7f9-e146cdd12458'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:21:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Delete snapshot completed successfully. Jun 25 18:21:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1b111013-47d5-47ea-b71d-6a22cdab31b9 tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-7e5efe94-e0cb-4804-b529-ede4d9e66405-delete_snapshot" released by "delete_snapshot" :: held 7.473s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "cinder-a86df117-eb5a-4c39-a1f9-ca374db54528-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-a86df117-eb5a-4c39-a1f9-ca374db54528-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:05 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3afc0dd-755a-46c2-887f-1d46a9096f65]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:05 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 Jun 25 18:21:05 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:06 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528" returned: 0 in 1.215s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:06 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528 Jun 25 18:21:06 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:07 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a86df117-eb5a-4c39-a1f9-ca374db54528" returned: 0 in 1.263s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-quobyte-a86df117-eb5a-4c39-a1f9-ca374db54528" released by "delete_volume" :: held 2.568s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:08 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Created reservations ['354d9452-c047-4d5d-bcad-eb87b5def283', '03ad50fb-fade-4754-a9a2-2a57f73b9033', '7ef858eb-849a-4e48-bccf-a4d98eec9ec3', '582dc4b3-b63d-44aa-a853-c2eeb5aa2dd8'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:21:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:08 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:21:08 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:09 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-be0ed54a-17da-4cb7-b709-865381717edd req-6b9974ee-4add-42c5-afb2-d2b578fa0373 tempest-TestInstancesWithCinderVolumes-1170378554 None] Terminate volume connection completed successfully. Jun 25 18:21:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-be0ed54a-17da-4cb7-b709-865381717edd req-6b9974ee-4add-42c5-afb2-d2b578fa0373 tempest-TestInstancesWithCinderVolumes-1170378554 None] Deleting attachment a70faa1c-80b0-4ed6-a136-808844a78e2c. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:21:09 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.551s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:09 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:21:09 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Deleted volume successfully. Jun 25 18:21:09 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-666c8ca9-505a-4cfe-9ff4-3689ecee030e tempest-SnapshotsActionsTest-1334981912 None] Lock "cinder-a86df117-eb5a-4c39-a1f9-ca374db54528-delete_volume" released by "delete_volume" :: held 4.564s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "cinder-424be698-7e2b-4e57-a987-2e841318f461-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-424be698-7e2b-4e57-a987-2e841318f461-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "cinder-quobyte-424be698-7e2b-4e57-a987-2e841318f461" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-quobyte-424be698-7e2b-4e57-a987-2e841318f461" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:14 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ccc766-ad86-4e98-8ae3-48444e466c61]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:14 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 Jun 25 18:21:14 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:15 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461" returned: 0 in 1.061s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:15 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 Jun 25 18:21:15 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:15 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461" returned: 1 in 0.849s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:15 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461 Jun 25 18:21:15 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:16 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-424be698-7e2b-4e57-a987-2e841318f461" returned: 0 in 0.814s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-quobyte-424be698-7e2b-4e57-a987-2e841318f461" released by "delete_volume" :: held 2.810s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:16 devstack cinder-volume[93767]: WARNING cinder.quota [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1163409156-2063810568 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1163409156-2063810568, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:21:16 devstack cinder-volume[93767]: WARNING cinder.quota [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1163409156-2063810568 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1163409156-2063810568, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:21:16 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Created reservations ['f4e72605-fc3a-4591-abee-74ff6d591747', 'b8525afa-7d85-4880-8e94-d0b0fb869c7e', 'bd360053-b661-4f90-9caa-505d3ff1a30b', '9409b86b-50da-46bf-87a5-d845df4ca097'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:21:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:16 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:21:17 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Flow 'volume_create_manager' (4b5841a9-cd13-413b-ac79-1e953036c382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d57fa03-646a-49b0-b542-e4d02d304d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d57fa03-646a-49b0-b542-e4d02d304d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-727405535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c17a419-b609-437a-a448-6a534f5d9ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406b084cc63e4d07aaf181d736cafc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:18Z,use_quota=True,user_id='b223b3d40b6b4ae58de9210ffcd646e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfb7d93-cb95-4dfb-9812-49bb9a669a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfb7d93-cb95-4dfb-9812-49bb9a669a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fbbb49-e446-49c2-a5a2-18ab021f3374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fbbb49-e446-49c2-a5a2-18ab021f3374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c17a419-b609-437a-a448-6a534f5d9ce4', 'volume_name': 'volume-1c17a419-b609-437a-a448-6a534f5d9ce4', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91070f1-7041-482e-9109-905a4f07a57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91070f1-7041-482e-9109-905a4f07a57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21eaee31-a390-46ef-835e-ef7430a1ef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:17 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Volume 1c17a419-b609-437a-a448-6a534f5d9ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c17a419-b609-437a-a448-6a534f5d9ce4', 'volume_size': 1} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-727405535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c17a419-b609-437a-a448-6a534f5d9ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406b084cc63e4d07aaf181d736cafc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:18Z,use_quota=True,user_id='b223b3d40b6b4ae58de9210ffcd646e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Creating volume 1c17a419-b609-437a-a448-6a534f5d9ce4 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:17 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:17 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.839s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:21:17 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4 1073741824 Jun 25 18:21:17 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Deleted volume successfully. Jun 25 18:21:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-970ffb17-1923-4863-be70-efa3b0d6230b tempest-TestInstancesWithCinderVolumes-1170378554 None] Lock "cinder-424be698-7e2b-4e57-a987-2e841318f461-delete_volume" released by "delete_volume" :: held 3.958s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:18 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4 1073741824" returned: 0 in 1.214s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:19 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4 Jun 25 18:21:19 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:20 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4" returned: 0 in 0.988s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] <== create_volume: return (2269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:21:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.272s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21eaee31-a390-46ef-835e-ef7430a1ef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c17a419-b609-437a-a448-6a534f5d9ce4', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49d16b4-ac3d-40b9-9985-a4234132c4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:20 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Volume volume-1c17a419-b609-437a-a448-6a534f5d9ce4 (1c17a419-b609-437a-a448-6a534f5d9ce4): created successfully Jun 25 18:21:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49d16b4-ac3d-40b9-9985-a4234132c4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Flow 'volume_create_manager' (4b5841a9-cd13-413b-ac79-1e953036c382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:20 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e199a3fc-76d6-4808-918d-782f1aee4b7e tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Created volume successfully. Jun 25 18:21:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Acquiring lock "cinder-1c17a419-b609-437a-a448-6a534f5d9ce4-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "cinder-1c17a419-b609-437a-a448-6a534f5d9ce4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Acquiring lock "cinder-quobyte-1c17a419-b609-437a-a448-6a534f5d9ce4" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "cinder-quobyte-1c17a419-b609-437a-a448-6a534f5d9ce4" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50bd11c-644c-47a9-8c3e-bcef436c9c5f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:22 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4 Jun 25 18:21:22 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:23 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4" returned: 0 in 1.046s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:23 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4 Jun 25 18:21:23 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Flow 'volume_create_manager' (e4751149-a1cd-4a18-afbd-2a828fe37fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea34872-9a6d-43f4-bcb7-c6cb1a3e1c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea34872-9a6d-43f4-bcb7-c6cb1a3e1c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a43669-e759-4b98-a5f7-e7569e6796e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c93611332c4d0a90a411a5b09ebde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:24Z,use_quota=True,user_id='89052c44fa9e4374b61685bcc2c863c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be06a619-48b1-490f-9e79-115fc333edf6),volume_type_id=be06a619-48b1-490f-9e79-115fc333edf6)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:24 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d805ea64-5764-458b-80bc-34b07d23105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d805ea64-5764-458b-80bc-34b07d23105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ba0335-476b-4b55-bed8-6f2edf8b17c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.image.glance [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Creating Keystone auth plugin from conf {{(pid=93767) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1c17a419-b609-437a-a448-6a534f5d9ce4" returned: 0 in 0.916s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "cinder-quobyte-1c17a419-b609-437a-a448-6a534f5d9ce4" released by "delete_volume" :: held 2.043s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Created reservations ['69d6f059-3b76-468f-8250-d2bd04c9da88', 'ef0e6f27-e689-48e3-939e-5bd9450f209d', '1bf64b0c-ff08-41a7-aacb-d664d1d3d6df', '059679e6-cd6f-4faa-8fc7-4b6403aa1ac5'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:24 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:21:24 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ba0335-476b-4b55-bed8-6f2edf8b17c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93a43669-e759-4b98-a5f7-e7569e6796e7', 'volume_name': 'volume-93a43669-e759-4b98-a5f7-e7569e6796e7', 'volume_size': 1, 'image_id': 'e5066b06-595c-450c-b641-acfe4554300a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5066b06-595c-450c-b641-acfe4554300a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7dfbb3de9e95a894e1850397dfd95de1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7c93611332c4d0a90a411a5b09ebde7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4450fd3796dfcfe2a5fd667ec37546b7d527a811f53e4bdefb77d107be70b393f74e4a7f976ba38e3a7a15e6c889d3bd3b09c5c1695c9f57bb83c9741b42668', 'id': 'e5066b06-595c-450c-b641-acfe4554300a', 'created_at': datetime.datetime(2026, 6, 25, 16, 21, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 21, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5066b06-595c-450c-b641-acfe4554300a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c652e9-820e-4128-a1ed-3be350f85277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c652e9-820e-4128-a1ed-3be350f85277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b5775f-349c-4021-91e9-4e49f9b6f798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:24 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Volume 93a43669-e759-4b98-a5f7-e7569e6796e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93a43669-e759-4b98-a5f7-e7569e6796e7', 'volume_size': 1, 'image_id': 'e5066b06-595c-450c-b641-acfe4554300a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5066b06-595c-450c-b641-acfe4554300a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7dfbb3de9e95a894e1850397dfd95de1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7c93611332c4d0a90a411a5b09ebde7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4450fd3796dfcfe2a5fd667ec37546b7d527a811f53e4bdefb77d107be70b393f74e4a7f976ba38e3a7a15e6c889d3bd3b09c5c1695c9f57bb83c9741b42668', 'id': 'e5066b06-595c-450c-b641-acfe4554300a', 'created_at': datetime.datetime(2026, 6, 25, 16, 21, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 21, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5066b06-595c-450c-b641-acfe4554300a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Trying to clone 93a43669-e759-4b98-a5f7-e7569e6796e7 from image e5066b06-595c-450c-b641-acfe4554300a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5066b06-595c-450c-b641-acfe4554300a', 'metadata': {}}]). {{(pid=93767) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:21:24 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:21:24 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Image download 0.00 MB at 0.00 MB/s Jun 25 18:21:25 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eabc2a-621c-4d16-b294-e62dc0edbbb3]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:25 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD Jun 25 18:21:25 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:25 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.888s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:25 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:21:25 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Deleted volume successfully. Jun 25 18:21:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-63f7df47-b96b-482c-8748-f9671b95ca78 tempest-VolumeQuotasNegativeTestJSON-1640622625 None] Lock "cinder-1c17a419-b609-437a-a448-6a534f5d9ce4-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:26 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD" returned: 0 in 0.996s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:26 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD Jun 25 18:21:26 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:26 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Flow 'volume_create_manager' (0ac34806-b8d1-4e56-8b3e-5256091f4337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ea52d5-c4c1-4c94-abf0-a79978bef376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ea52d5-c4c1-4c94-abf0-a79978bef376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-605025843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04549bdb-4dd6-46aa-846f-b393af41a5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a22ca36985840cf8bd9c0d087652a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:27Z,use_quota=True,user_id='cf857bc247cb4933815411b87f445aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2ab42c-895e-45f3-b3b5-a21fa07b2b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2ab42c-895e-45f3-b3b5-a21fa07b2b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632bdc77-f0d0-42c5-895e-6e37a1034efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632bdc77-f0d0-42c5-895e-6e37a1034efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04549bdb-4dd6-46aa-846f-b393af41a5bf', 'volume_name': 'volume-04549bdb-4dd6-46aa-846f-b393af41a5bf', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47092a2c-44bc-454c-8ebe-242b6ad7cfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47092a2c-44bc-454c-8ebe-242b6ad7cfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe294e7e-927a-42b1-9c77-804ad7e20843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:27 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Volume 04549bdb-4dd6-46aa-846f-b393af41a5bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04549bdb-4dd6-46aa-846f-b393af41a5bf', 'volume_size': 1} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-605025843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04549bdb-4dd6-46aa-846f-b393af41a5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a22ca36985840cf8bd9c0d087652a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:27Z,use_quota=True,user_id='cf857bc247cb4933815411b87f445aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Creating volume 04549bdb-4dd6-46aa-846f-b393af41a5bf {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:27 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:27 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD" returned: 1 in 1.150s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Temporary image e5066b06-595c-450c-b641-acfe4554300a is fetched for user 89052c44fa9e4374b61685bcc2c863c0. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:21:27 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf 1073741824 Jun 25 18:21:27 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1bd3c2-4e5a-48c1-b33c-1b1e57ee7ced]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:27 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD Jun 25 18:21:27 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:28 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf 1073741824" returned: 0 in 1.309s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:28 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf Jun 25 18:21:28 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:28 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD" returned: 0 in 1.321s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:28 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD Jun 25 18:21:28 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:29 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf" returned: 0 in 0.949s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe294e7e-927a-42b1-9c77-804ad7e20843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04549bdb-4dd6-46aa-846f-b393af41a5bf', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d579fa-3f70-402b-9f4e-f66b07262f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:29 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Volume volume-04549bdb-4dd6-46aa-846f-b393af41a5bf (04549bdb-4dd6-46aa-846f-b393af41a5bf): created successfully Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d579fa-3f70-402b-9f4e-f66b07262f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Flow 'volume_create_manager' (0ac34806-b8d1-4e56-8b3e-5256091f4337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1c12968c-1af2-4749-8cb4-8d92a06b17ea tempest-AttachVolumeTestJSON-1045690878 None] Created volume successfully. Jun 25 18:21:29 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD" returned: 1 in 0.969s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a43669-e759-4b98-a5f7-e7569e6796e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c93611332c4d0a90a411a5b09ebde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:24Z,use_quota=True,user_id='89052c44fa9e4374b61685bcc2c863c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be06a619-48b1-490f-9e79-115fc333edf6),volume_type_id=be06a619-48b1-490f-9e79-115fc333edf6)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Creating volume 93a43669-e759-4b98-a5f7-e7569e6796e7 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:29 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:21:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:29 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 1073741824 Jun 25 18:21:29 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:30 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 1073741824" returned: 0 in 1.224s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:31 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 Jun 25 18:21:31 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:31 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7" returned: 0 in 0.788s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:21:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:31 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Attempting download of e5066b06-595c-450c-b641-acfe4554300a ((None, [{'url': 'file:///opt/stack/data/glance/images/e5066b06-595c-450c-b641-acfe4554300a', 'metadata': {}}])) to volume 93a43669-e759-4b98-a5f7-e7569e6796e7. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:21:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cd6af8-369b-4776-8bec-6c5211526013]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5066b06-595c-450c-b641-acfe4554300a_f93nl10p {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:32 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5066b06-595c-450c-b641-acfe4554300a_f93nl10p Jun 25 18:21:32 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:32 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5066b06-595c-450c-b641-acfe4554300a_f93nl10p" returned: 0 in 0.942s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5066b06-595c-450c-b641-acfe4554300a_f93nl10p {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:32 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5066b06-595c-450c-b641-acfe4554300a_f93nl10p Jun 25 18:21:32 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:33 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5066b06-595c-450c-b641-acfe4554300a_f93nl10p" returned: 1 in 0.969s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5066b06-595c-450c-b641-acfe4554300a_f93nl10p' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:33 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc7615-a751-47fe-9552-57f80ac5a60d]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:33 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD Jun 25 18:21:33 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Flow 'volume_create_manager' (72d84386-edf0-4410-9ffe-29c0e80bbd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff94d71a-423b-4b41-9996-58eabe49a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff94d71a-423b-4b41-9996-58eabe49a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-764648637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b48002-36ff-4b6a-87c2-9781ee30fdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a0bad786a7419886162adac423da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:34Z,use_quota=True,user_id='b25abc69657f498db6df8947768b2d1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd66afb-8759-47fb-95e1-1f6ecb35a80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd66afb-8759-47fb-95e1-1f6ecb35a80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384f0e76-1efa-4ea8-9815-d63d8eba50b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384f0e76-1efa-4ea8-9815-d63d8eba50b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b48002-36ff-4b6a-87c2-9781ee30fdfb', 'volume_name': 'volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a1f160-244f-414c-be82-457748d087d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a1f160-244f-414c-be82-457748d087d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc6eb22-bb34-4c91-8730-544f65c3c8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:34 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Volume c4b48002-36ff-4b6a-87c2-9781ee30fdfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb', 'volume_size': 1} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-764648637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b48002-36ff-4b6a-87c2-9781ee30fdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a0bad786a7419886162adac423da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:34Z,use_quota=True,user_id='b25abc69657f498db6df8947768b2d1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Creating volume c4b48002-36ff-4b6a-87c2-9781ee30fdfb {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:34 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-de74c165-615f-4904-b007-e0ebfa6490be req-d4d646fc-5054-4a19-8da2-a64aac448dfa tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:34 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb 1073741824 Jun 25 18:21:34 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:34 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD" returned: 0 in 1.041s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:34 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD Jun 25 18:21:34 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:35 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb 1073741824" returned: 0 in 1.050s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:35 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb Jun 25 18:21:35 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:35 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD" returned: 1 in 0.832s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:35 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] e5066b06-595c-450c-b641-acfe4554300a was raw, converting to raw {{(pid=93767) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:21:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:35 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 Jun 25 18:21:35 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:36 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb" returned: 0 in 0.765s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-de74c165-615f-4904-b007-e0ebfa6490be req-d4d646fc-5054-4a19-8da2-a64aac448dfa tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.857s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc6eb22-bb34-4c91-8730-544f65c3c8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554d5a65-c910-4bea-87c0-b98c8bbd7f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9b32ab-dbdb-45dd-8c05-45338b4a37da]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-de74c165-615f-4904-b007-e0ebfa6490be req-d4d646fc-5054-4a19-8da2-a64aac448dfa tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:36 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Volume volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb (c4b48002-36ff-4b6a-87c2-9781ee30fdfb): created successfully Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554d5a65-c910-4bea-87c0-b98c8bbd7f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Flow 'volume_create_manager' (72d84386-edf0-4410-9ffe-29c0e80bbd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:36 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-7c3aa5a4-99c3-402b-b1e6-89633e89117d tempest-VolumesServicesTestJSON-1815111271 None] Created volume successfully. Jun 25 18:21:36 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf Jun 25 18:21:36 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:36 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7" returned: 0 in 0.925s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5066b06-595c-450c-b641-acfe4554300a_vql9rixbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:21:36 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 18:21:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:36 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 1G Jun 25 18:21:36 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:37 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-de74c165-615f-4904-b007-e0ebfa6490be req-d4d646fc-5054-4a19-8da2-a64aac448dfa tempest-AttachVolumeTestJSON-1045690878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf" returned: 0 in 0.909s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-de74c165-615f-4904-b007-e0ebfa6490be req-d4d646fc-5054-4a19-8da2-a64aac448dfa tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.951s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-de74c165-615f-4904-b007-e0ebfa6490be req-d4d646fc-5054-4a19-8da2-a64aac448dfa tempest-AttachVolumeTestJSON-1045690878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-04549bdb-4dd6-46aa-846f-b393af41a5bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '192ea596-0ca8-42ca-95c6-009356e2a0b3', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:21:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-de74c165-615f-4904-b007-e0ebfa6490be req-d4d646fc-5054-4a19-8da2-a64aac448dfa tempest-AttachVolumeTestJSON-1045690878 None] attachment_update completed successfully. Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Acquiring lock "cinder-c4b48002-36ff-4b6a-87c2-9781ee30fdfb-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:37 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 1G" returned: 0 in 0.966s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Lock "cinder-c4b48002-36ff-4b6a-87c2-9781ee30fdfb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Acquiring lock "cinder-quobyte-c4b48002-36ff-4b6a-87c2-9781ee30fdfb" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b5ac65-663b-42bc-b97c-731b27c94e85]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Lock "cinder-quobyte-c4b48002-36ff-4b6a-87c2-9781ee30fdfb" acquired by "delete_volume" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[204b8e8a-efc1-43ef-8d82-ff41eed60734]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:37 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 Jun 25 18:21:37 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:37 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb Jun 25 18:21:37 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:38 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7" returned: 0 in 0.923s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:38 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb" returned: 0 in 0.965s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:38 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 Jun 25 18:21:38 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb Jun 25 18:21:38 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:38 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:39 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c4b48002-36ff-4b6a-87c2-9781ee30fdfb" returned: 0 in 0.874s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Lock "cinder-quobyte-c4b48002-36ff-4b6a-87c2-9781ee30fdfb" released by "delete_volume" :: held 1.900s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Created reservations ['68aa85df-7b0f-4374-847e-98bd255e952e', '5fb1856c-5571-4e76-bf02-10c1a713c61c', '8a420573-3085-4659-a182-63f53b5043a4', '6c580d7b-d868-46c9-831f-93a83a40fcdd'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:21:39 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7" returned: 1 in 1.146s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Downloaded image e5066b06-595c-450c-b641-acfe4554300a ((None, [{'url': 'file:///opt/stack/data/glance/images/e5066b06-595c-450c-b641-acfe4554300a', 'metadata': {}}])) to volume 93a43669-e759-4b98-a5f7-e7569e6796e7 successfully. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Temporary image e5066b06-595c-450c-b641-acfe4554300a for user 89052c44fa9e4374b61685bcc2c863c0 is deleted. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Marking volume 93a43669-e759-4b98-a5f7-e7569e6796e7 as bootable. {{(pid=93767) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Copying metadata from image e5066b06-595c-450c-b641-acfe4554300a to 93a43669-e759-4b98-a5f7-e7569e6796e7. {{(pid=93767) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Creating volume glance metadata for volume 93a43669-e759-4b98-a5f7-e7569e6796e7 backed by image e5066b06-595c-450c-b641-acfe4554300a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e5066b06-595c-450c-b641-acfe4554300a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7dfbb3de9e95a894e1850397dfd95de1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93767) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:39 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:21:39 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b5775f-349c-4021-91e9-4e49f9b6f798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a43669-e759-4b98-a5f7-e7569e6796e7', 'volume_size': 1, 'image_id': 'e5066b06-595c-450c-b641-acfe4554300a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5066b06-595c-450c-b641-acfe4554300a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7dfbb3de9e95a894e1850397dfd95de1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7c93611332c4d0a90a411a5b09ebde7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4450fd3796dfcfe2a5fd667ec37546b7d527a811f53e4bdefb77d107be70b393f74e4a7f976ba38e3a7a15e6c889d3bd3b09c5c1695c9f57bb83c9741b42668', 'id': 'e5066b06-595c-450c-b641-acfe4554300a', 'created_at': datetime.datetime(2026, 6, 25, 16, 21, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 21, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5066b06-595c-450c-b641-acfe4554300a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007aed58-59e2-4156-aae3-d8ba69967408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Volume volume-93a43669-e759-4b98-a5f7-e7569e6796e7 (93a43669-e759-4b98-a5f7-e7569e6796e7): created successfully Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007aed58-59e2-4156-aae3-d8ba69967408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Flow 'volume_create_manager' (e4751149-a1cd-4a18-afbd-2a828fe37fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a4518003-5fda-4fb2-b9ad-11b462ba4448 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Created volume successfully. Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:40 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:21:40 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:40 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.108s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:21:40 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Deleted volume successfully. Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Acquiring lock "cinder-93a43669-e759-4b98-a5f7-e7569e6796e7-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-db82c0bc-ed71-49b4-83fb-0072620800d9 tempest-VolumesServicesTestJSON-1815111271 None] Lock "cinder-c4b48002-36ff-4b6a-87c2-9781ee30fdfb-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "cinder-93a43669-e759-4b98-a5f7-e7569e6796e7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Acquiring lock "cinder-quobyte-93a43669-e759-4b98-a5f7-e7569e6796e7" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "cinder-quobyte-93a43669-e759-4b98-a5f7-e7569e6796e7" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf368d9-a821-4d95-9394-eb3e3f8740d0]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:41 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 Jun 25 18:21:41 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:41 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.183s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:21:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:21:42 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7" returned: 0 in 1.189s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:42 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 Jun 25 18:21:42 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Flow 'volume_create_manager' (b16081c2-dc1a-4e9c-a005-9afab78fc636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ca73f5-33c4-40b9-ad76-299aa46baab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:43 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7" returned: 1 in 1.308s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ca73f5-33c4-40b9-ad76-299aa46baab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1314802657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a22ca36985840cf8bd9c0d087652a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:44Z,use_quota=True,user_id='cf857bc247cb4933815411b87f445aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568df29d-3b66-4988-a7d3-29d392ac8efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:43 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7 Jun 25 18:21:43 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568df29d-3b66-4988-a7d3-29d392ac8efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36059126-92a6-49b4-90cd-8ea02e1eaba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36059126-92a6-49b4-90cd-8ea02e1eaba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33', 'volume_name': 'volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5530ad68-183f-4494-8dd3-cd9121e1c840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5530ad68-183f-4494-8dd3-cd9121e1c840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4446f3a-bc31-4cb7-98b1-7f21e86367e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:43 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Volume 893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33', 'volume_size': 1} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1314802657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a22ca36985840cf8bd9c0d087652a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:44Z,use_quota=True,user_id='cf857bc247cb4933815411b87f445aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Creating volume 893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:43 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:21:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:43 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 1073741824 Jun 25 18:21:43 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:44 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93a43669-e759-4b98-a5f7-e7569e6796e7" returned: 0 in 1.091s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "cinder-quobyte-93a43669-e759-4b98-a5f7-e7569e6796e7" released by "delete_volume" :: held 3.696s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:44 devstack cinder-volume[93767]: WARNING cinder.quota [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:21:44 devstack cinder-volume[93767]: WARNING cinder.quota [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:21:44 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Created reservations ['9ff731aa-ab46-49c4-95a5-375bf3ea2e76', '74b73e4b-69fb-422f-a715-a05fe6f0e77c', 'de562969-6661-4f97-830c-9292e79249e7', 'b89ca5c2-2ea7-40f5-a6ed-45feb452bd35'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:21:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:45 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:21:45 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:45 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 1073741824" returned: 0 in 1.485s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:45 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 Jun 25 18:21:45 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:46 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.110s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:21:46 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Deleted volume successfully. Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a576943-07f9-49fc-b329-024cf5e41037 tempest-VolumeAndVolumeTypeFromImageTest-997763919 None] Lock "cinder-93a43669-e759-4b98-a5f7-e7569e6796e7-delete_volume" released by "delete_volume" :: held 5.216s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:46 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33" returned: 0 in 1.235s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] <== create_volume: return (2788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.799s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4446f3a-bc31-4cb7-98b1-7f21e86367e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d34d49f-f483-44bb-ad79-2f1430284cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:46 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Volume volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 (893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33): created successfully Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d34d49f-f483-44bb-ad79-2f1430284cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Flow 'volume_create_manager' (b16081c2-dc1a-4e9c-a005-9afab78fc636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:46 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-206b91a0-cf09-4a16-a5a0-b15a04dd679e tempest-AttachVolumeTestJSON-1045690878 None] Created volume successfully. Jun 25 18:21:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-1d6b257f-bbc3-4399-8dfa-44cf5fe04a8d req-e8609fe1-df99-4d78-82f0-fffc9a2de539 tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-1d6b257f-bbc3-4399-8dfa-44cf5fe04a8d req-e8609fe1-df99-4d78-82f0-fffc9a2de539 tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:50 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[026bd236-56ea-4a17-b0c2-132cae580651]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-1d6b257f-bbc3-4399-8dfa-44cf5fe04a8d req-e8609fe1-df99-4d78-82f0-fffc9a2de539 tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:51 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 Jun 25 18:21:51 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:52 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Flow 'volume_create_manager' (707373c2-9b51-4ecd-bc1a-5aa11452acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646faef4-004d-4685-9ddf-cd2e6bee2f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-1d6b257f-bbc3-4399-8dfa-44cf5fe04a8d req-e8609fe1-df99-4d78-82f0-fffc9a2de539 tempest-AttachVolumeTestJSON-1045690878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33" returned: 0 in 1.348s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-1d6b257f-bbc3-4399-8dfa-44cf5fe04a8d req-e8609fe1-df99-4d78-82f0-fffc9a2de539 tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.382s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646faef4-004d-4685-9ddf-cd2e6bee2f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1762608908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3db262e-61f5-44c7-9fff-7828e022a749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222da18efba448dbbea9460a803074c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:52Z,use_quota=True,user_id='ea64cf25c0274a309219ce78cd62fc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59531281-659f-46c6-970c-42648ff94866),volume_type_id=59531281-659f-46c6-970c-42648ff94866)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2ea216-5cd2-453a-8360-a529b66a5462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2ea216-5cd2-453a-8360-a529b66a5462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0001be-a4ec-4628-8f32-206158b46844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0001be-a4ec-4628-8f32-206158b46844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3db262e-61f5-44c7-9fff-7828e022a749', 'volume_name': 'volume-f3db262e-61f5-44c7-9fff-7828e022a749', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455de919-7572-403f-83bc-4879301dbca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455de919-7572-403f-83bc-4879301dbca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3c1f26-d6df-4475-a06b-f8d939a629de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:52 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Volume f3db262e-61f5-44c7-9fff-7828e022a749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3db262e-61f5-44c7-9fff-7828e022a749', 'volume_size': 1} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1762608908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3db262e-61f5-44c7-9fff-7828e022a749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222da18efba448dbbea9460a803074c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:52Z,use_quota=True,user_id='ea64cf25c0274a309219ce78cd62fc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59531281-659f-46c6-970c-42648ff94866),volume_type_id=59531281-659f-46c6-970c-42648ff94866)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Creating volume f3db262e-61f5-44c7-9fff-7828e022a749 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:52 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:52 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749 1073741824 Jun 25 18:21:52 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-1d6b257f-bbc3-4399-8dfa-44cf5fe04a8d req-e8609fe1-df99-4d78-82f0-fffc9a2de539 tempest-AttachVolumeTestJSON-1045690878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5dbe773-916a-4c01-865f-110d8a7dcb0e', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:21:52 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-1d6b257f-bbc3-4399-8dfa-44cf5fe04a8d req-e8609fe1-df99-4d78-82f0-fffc9a2de539 tempest-AttachVolumeTestJSON-1045690878 None] attachment_update completed successfully. Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (de28c669-b852-4e81-961c-af310944193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd0cea5-8f83-4350-bf41-d271063e401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd0cea5-8f83-4350-bf41-d271063e401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392354887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e982cd2b-9295-49ac-85bc-8c800337df66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:53Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb392cec-c507-4a15-afda-9c9a2ac223d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb392cec-c507-4a15-afda-9c9a2ac223d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be6bb8f-9399-4def-9180-d7e2ab47fcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be6bb8f-9399-4def-9180-d7e2ab47fcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e982cd2b-9295-49ac-85bc-8c800337df66', 'volume_name': 'volume-e982cd2b-9295-49ac-85bc-8c800337df66', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b55328c-8efe-4565-851b-9cd870b7bc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b55328c-8efe-4565-851b-9cd870b7bc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b69e92-c404-49dc-9f2d-0cab588d4e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:53 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume e982cd2b-9295-49ac-85bc-8c800337df66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e982cd2b-9295-49ac-85bc-8c800337df66', 'volume_size': 1} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:53 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749 1073741824" returned: 0 in 1.216s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:53 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749 Jun 25 18:21:53 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:54 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749" returned: 0 in 0.768s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392354887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e982cd2b-9295-49ac-85bc-8c800337df66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:53Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Creating volume e982cd2b-9295-49ac-85bc-8c800337df66 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:54 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3c1f26-d6df-4475-a06b-f8d939a629de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3db262e-61f5-44c7-9fff-7828e022a749', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201b8baf-c980-4f55-bb22-b6b129fb5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:54 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66 1073741824 Jun 25 18:21:54 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:54 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Volume volume-f3db262e-61f5-44c7-9fff-7828e022a749 (f3db262e-61f5-44c7-9fff-7828e022a749): created successfully Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201b8baf-c980-4f55-bb22-b6b129fb5c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Flow 'volume_create_manager' (707373c2-9b51-4ecd-bc1a-5aa11452acd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:54 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-60381e20-e1d4-458c-ae6a-3e099e2e240c tempest-VolumeTypesAccessTest-1454219016 None] Created volume successfully. Jun 25 18:21:55 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66 1073741824" returned: 0 in 1.097s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:55 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66 Jun 25 18:21:55 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Acquiring lock "cinder-f3db262e-61f5-44c7-9fff-7828e022a749-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Lock "cinder-f3db262e-61f5-44c7-9fff-7828e022a749-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Acquiring lock "cinder-quobyte-f3db262e-61f5-44c7-9fff-7828e022a749" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Lock "cinder-quobyte-f3db262e-61f5-44c7-9fff-7828e022a749" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:55 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bfa0ab-86e2-41e3-8ed4-9dc887f1ba0d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:55 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749 Jun 25 18:21:55 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:56 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66" returned: 0 in 0.722s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:21:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b69e92-c404-49dc-9f2d-0cab588d4e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e982cd2b-9295-49ac-85bc-8c800337df66', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fc5484-5792-4f1a-85bb-6d0d7cf9452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:56 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume volume-e982cd2b-9295-49ac-85bc-8c800337df66 (e982cd2b-9295-49ac-85bc-8c800337df66): created successfully Jun 25 18:21:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fc5484-5792-4f1a-85bb-6d0d7cf9452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (de28c669-b852-4e81-961c-af310944193e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:56 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a30b2e49-e6ee-4ecc-be7a-8e546d1fe1a3 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created volume successfully. Jun 25 18:21:56 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749" returned: 0 in 0.955s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:56 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749 Jun 25 18:21:56 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f3db262e-61f5-44c7-9fff-7828e022a749" returned: 0 in 0.821s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:57 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Lock "cinder-quobyte-f3db262e-61f5-44c7-9fff-7828e022a749" released by "delete_volume" :: held 1.848s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:57 devstack cinder-volume[93767]: WARNING cinder.quota [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-750262631 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-750262631, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:21:57 devstack cinder-volume[93767]: WARNING cinder.quota [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-750262631 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-750262631, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:21:57 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Created reservations ['b3ef1420-cc29-4517-a602-ab14d2feb72c', '37cd1e1c-da93-4aca-8583-ecad8d35b3ff', '46d4daa2-6cd2-4a02-bfb5-6c7fddb3170d', '45eb98d6-ba30-447d-961b-969bdeaa713f'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:21:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:57 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:21:57 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=88,cinder:SELECT=70,cinder:DELETE=5,cinder:INSERT=27 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=71,cinder:INSERT=22,cinder:UPDATE=86,cinder:DELETE=9 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (fecaafec-96cd-4b0a-b56b-8ad8d1d8b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaec8537-a1f2-4fa6-9431-38c4b5f87ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaec8537-a1f2-4fa6-9431-38c4b5f87ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2092692144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b204863-2d34-421f-976e-08d0d68aa4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:58Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8250a1a1-e257-4181-9697-e1576f1a9534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8250a1a1-e257-4181-9697-e1576f1a9534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c570cc67-ecfd-488c-860d-7e8622a24047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c570cc67-ecfd-488c-860d-7e8622a24047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b204863-2d34-421f-976e-08d0d68aa4ec', 'volume_name': 'volume-2b204863-2d34-421f-976e-08d0d68aa4ec', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb60fec-7b04-4efe-9957-c24327d6c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb60fec-7b04-4efe-9957-c24327d6c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1b398d-b47d-4090-9f91-9f045df108b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:58 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume 2b204863-2d34-421f-976e-08d0d68aa4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b204863-2d34-421f-976e-08d0d68aa4ec', 'volume_size': 1} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2092692144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b204863-2d34-421f-976e-08d0d68aa4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:58Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Creating volume 2b204863-2d34-421f-976e-08d0d68aa4ec {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:58 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:21:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:58 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec 1073741824 Jun 25 18:21:58 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:59 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.503s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (faef251c-cb79-49d0-bce3-eceb0592217a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94aea48-bd44-448c-a017-f6550366db9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:59 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Deleted volume successfully. Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94aea48-bd44-448c-a017-f6550366db9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974118569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b54e6bc-a155-478b-806e-e7d667983aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:59Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6dfcced-5cd3-478a-b35b-0ea70ffb4715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6dfcced-5cd3-478a-b35b-0ea70ffb4715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adc3649-cab3-4c5d-879e-94963defc38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adc3649-cab3-4c5d-879e-94963defc38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b54e6bc-a155-478b-806e-e7d667983aa8', 'volume_name': 'volume-0b54e6bc-a155-478b-806e-e7d667983aa8', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99fc4c8-db2b-4813-ab98-322a58d953f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99fc4c8-db2b-4813-ab98-322a58d953f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2ea1dc-447c-4021-9af1-f24d43520b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:59 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume 0b54e6bc-a155-478b-806e-e7d667983aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b54e6bc-a155-478b-806e-e7d667983aa8', 'volume_size': 1} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-22f17c99-4f3b-4062-adc2-88c8c2d8ca7e tempest-VolumeTypesAccessTest-1454219016 None] Lock "cinder-f3db262e-61f5-44c7-9fff-7828e022a749-delete_volume" released by "delete_volume" :: held 3.907s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (df0e58d5-b5e9-450a-b108-f43725865958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d9c3ae-6024-4fd0-99ad-ac9cb9133c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d9c3ae-6024-4fd0-99ad-ac9cb9133c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-81790755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:00Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c2f6d0-5272-41ee-ba3c-23239428f821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c2f6d0-5272-41ee-ba3c-23239428f821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb65fb6-0d36-4fbd-9a49-95fe7a3c477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb65fb6-0d36-4fbd-9a49-95fe7a3c477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe', 'volume_name': 'volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4228a6f5-483a-421a-a41c-e9f45b7db2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4228a6f5-483a-421a-a41c-e9f45b7db2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:00 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f613f6f0-73d3-416b-ab4b-f4d9a433fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:00 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume 4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe', 'volume_size': 1} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec 1073741824" returned: 0 in 1.803s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:00 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec Jun 25 18:22:00 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:00 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-b5cec32f-56c3-49ee-ad2d-94576c5f3f77 req-33f6d095-e15e-4db3-9fc7-33f8e7b2638d tempest-AttachVolumeTestJSON-1045690878 None] Terminate volume connection completed successfully. Jun 25 18:22:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-b5cec32f-56c3-49ee-ad2d-94576c5f3f77 req-33f6d095-e15e-4db3-9fc7-33f8e7b2638d tempest-AttachVolumeTestJSON-1045690878 None] Deleting attachment 192ea596-0ca8-42ca-95c6-009356e2a0b3. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (8193262a-7dcd-4248-8f02-1bbde813cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf49c1f-8569-49a6-9082-24f4dd784db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf49c1f-8569-49a6-9082-24f4dd784db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1143177011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23785aab-0ca7-43a6-bc69-f45d608bea3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:01Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe45ea6-60cb-4dc7-a9e4-4ce020d6426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe45ea6-60cb-4dc7-a9e4-4ce020d6426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d120fc64-e39b-46d9-8083-db6b84560de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d120fc64-e39b-46d9-8083-db6b84560de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23785aab-0ca7-43a6-bc69-f45d608bea3a', 'volume_name': 'volume-23785aab-0ca7-43a6-bc69-f45d608bea3a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e925ffc-0f91-41e6-9232-cf9e79cd2eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e925ffc-0f91-41e6-9232-cf9e79cd2eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84e9d14-1393-46e3-9313-40505bd505fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:01 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume 23785aab-0ca7-43a6-bc69-f45d608bea3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23785aab-0ca7-43a6-bc69-f45d608bea3a', 'volume_size': 1} Jun 25 18:22:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:02 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec" returned: 0 in 1.504s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] <== create_volume: return (3432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.435s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.461s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974118569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b54e6bc-a155-478b-806e-e7d667983aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:59Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Creating volume 0b54e6bc-a155-478b-806e-e7d667983aa8 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:02 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:02 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8 1073741824 Jun 25 18:22:02 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1b398d-b47d-4090-9f91-9f045df108b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b204863-2d34-421f-976e-08d0d68aa4ec', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c2c7ac-952d-41a2-8bec-23d207f45737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:02 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume volume-2b204863-2d34-421f-976e-08d0d68aa4ec (2b204863-2d34-421f-976e-08d0d68aa4ec): created successfully Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c2c7ac-952d-41a2-8bec-23d207f45737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (fecaafec-96cd-4b0a-b56b-8ad8d1d8b0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (ad571928-f559-4a61-80ae-7d442937a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b2a185-530f-45a8-b664-5ca60571b40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b2a185-530f-45a8-b664-5ca60571b40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1150860167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd58d3e-d360-4b5a-b51d-8f8b94b26d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:02Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380e47f1-9a84-4138-9985-6d39375bdf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380e47f1-9a84-4138-9985-6d39375bdf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd0adc6-933b-48ac-bd2b-587f6a308419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd0adc6-933b-48ac-bd2b-587f6a308419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd58d3e-d360-4b5a-b51d-8f8b94b26d44', 'volume_name': 'volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8549f6a4-65fe-4986-864c-0d728200b8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8549f6a4-65fe-4986-864c-0d728200b8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc00a3d1-525e-4a8d-96b8-47a09b6cb41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:02 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume 0dd58d3e-d360-4b5a-b51d-8f8b94b26d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44', 'volume_size': 1} Jun 25 18:22:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2c691a9a-0622-4a3c-b775-1dc9e27b1573 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created volume successfully. Jun 25 18:22:03 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8 1073741824" returned: 0 in 1.266s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:03 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8 Jun 25 18:22:03 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Flow 'volume_create_manager' (492dda49-cc23-497c-8edc-e40e9c3ea16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70fb0a3-0ad9-42c4-97cd-8bcf697a9a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70fb0a3-0ad9-42c4-97cd-8bcf697a9a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-877424696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ef05c5-25f6-4abf-9f7d-ed40b6a8701e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebadafdc6040b68f04be5133b8e119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:04Z,use_quota=True,user_id='ed310e784bfd491197e053cfcbaf90cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ea743e-ac48-44bd-b522-1619e75a6b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ea743e-ac48-44bd-b522-1619e75a6b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60aeb9c-c9b7-4326-b872-78034591823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60aeb9c-c9b7-4326-b872-78034591823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ef05c5-25f6-4abf-9f7d-ed40b6a8701e', 'volume_name': 'volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a31540b-251f-43c0-82ac-ba15c5e00e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a31540b-251f-43c0-82ac-ba15c5e00e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85988f58-f23e-47e0-91d6-552ba1d11c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:03 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Volume 41ef05c5-25f6-4abf-9f7d-ed40b6a8701e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e', 'volume_size': 1} Jun 25 18:22:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-e8e3a45c-d790-4b30-9649-00063e2b1bc9 req-feae0ad0-8334-4378-a12f-d4612ad62ed9 tempest-AttachVolumeTestJSON-1045690878 None] Terminate volume connection completed successfully. Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-e8e3a45c-d790-4b30-9649-00063e2b1bc9 req-feae0ad0-8334-4378-a12f-d4612ad62ed9 tempest-AttachVolumeTestJSON-1045690878 None] Deleting attachment d5dbe773-916a-4c01-865f-110d8a7dcb0e. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Flow 'volume_create_manager' (472039c1-08df-4b75-a0e7-4bf47659de00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be17229-087b-4d9a-99a5-816c4e3bec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be17229-087b-4d9a-99a5-816c4e3bec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1870268964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce0db73-7080-47fd-af3e-e38019d0d19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebadafdc6040b68f04be5133b8e119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:04Z,use_quota=True,user_id='ed310e784bfd491197e053cfcbaf90cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9700b2b5-d016-47a4-b8cf-f7690157236f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9700b2b5-d016-47a4-b8cf-f7690157236f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f332a0f7-da57-4428-9a4c-f39f8da7dc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f332a0f7-da57-4428-9a4c-f39f8da7dc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce0db73-7080-47fd-af3e-e38019d0d19b', 'volume_name': 'volume-3ce0db73-7080-47fd-af3e-e38019d0d19b', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defc4d6b-5d02-47e9-84d9-e8333361742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defc4d6b-5d02-47e9-84d9-e8333361742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a9c692-493d-40cb-8fc7-6b3ea6eb5579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:04 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Volume 3ce0db73-7080-47fd-af3e-e38019d0d19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce0db73-7080-47fd-af3e-e38019d0d19b', 'volume_size': 1} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:04 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8" returned: 0 in 1.296s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] <== create_volume: return (2633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.641s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.270s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-81790755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:00Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Creating volume 4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:04 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2ea1dc-447c-4021-9af1-f24d43520b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b54e6bc-a155-478b-806e-e7d667983aa8', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:04 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe 1073741824 Jun 25 18:22:04 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790bae79-d298-420f-9ac4-26475d3fd5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:04 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume volume-0b54e6bc-a155-478b-806e-e7d667983aa8 (0b54e6bc-a155-478b-806e-e7d667983aa8): created successfully Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790bae79-d298-420f-9ac4-26475d3fd5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (faef251c-cb79-49d0-bce3-eceb0592217a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-7c562ff6-12f5-4fc2-80d2-ee9881ede535 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created volume successfully. Jun 25 18:22:05 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe 1073741824" returned: 0 in 1.120s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:05 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe Jun 25 18:22:05 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:06 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe" returned: 0 in 0.940s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.529s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1143177011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23785aab-0ca7-43a6-bc69-f45d608bea3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:01Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Creating volume 23785aab-0ca7-43a6-bc69-f45d608bea3a {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:06 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f613f6f0-73d3-416b-ab4b-f4d9a433fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:06 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a 1073741824 Jun 25 18:22:06 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2fbdb2-7f3e-4f4f-bfcb-c21a469085e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:06 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe (4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe): created successfully Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2fbdb2-7f3e-4f4f-bfcb-c21a469085e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (df0e58d5-b5e9-450a-b108-f43725865958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:07 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-12ecf236-1c35-4886-b563-195d18b16180 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created volume successfully. Jun 25 18:22:08 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a 1073741824" returned: 0 in 1.599s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:08 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a Jun 25 18:22:08 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:09 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a" returned: 0 in 0.877s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] <== create_volume: return (2528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.531s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.936s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1150860167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd58d3e-d360-4b5a-b51d-8f8b94b26d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceb924773de456a82e4216455a91362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:02Z,use_quota=True,user_id='73b7acd159a345d2b08eff8f7a4870ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Creating volume 0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:09 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:09 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 1073741824 Jun 25 18:22:09 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84e9d14-1393-46e3-9313-40505bd505fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23785aab-0ca7-43a6-bc69-f45d608bea3a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c89d7b0-673c-4c2c-8b50-6ecfdf4566d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:09 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume volume-23785aab-0ca7-43a6-bc69-f45d608bea3a (23785aab-0ca7-43a6-bc69-f45d608bea3a): created successfully Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c89d7b0-673c-4c2c-8b50-6ecfdf4566d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (8193262a-7dcd-4248-8f02-1bbde813cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:09 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-af19507d-a78e-45d7-89ed-bef313c76c93 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created volume successfully. Jun 25 18:22:10 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 1073741824" returned: 0 in 1.425s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:10 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 Jun 25 18:22:10 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:11 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44" returned: 0 in 0.817s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.890s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-877424696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ef05c5-25f6-4abf-9f7d-ed40b6a8701e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebadafdc6040b68f04be5133b8e119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:04Z,use_quota=True,user_id='ed310e784bfd491197e053cfcbaf90cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Creating volume 41ef05c5-25f6-4abf-9f7d-ed40b6a8701e {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:11 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:11 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e 1073741824 Jun 25 18:22:11 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc00a3d1-525e-4a8d-96b8-47a09b6cb41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e8e637-3a2d-461d-a048-566b6b8de579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:11 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Volume volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 (0dd58d3e-d360-4b5a-b51d-8f8b94b26d44): created successfully Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e8e637-3a2d-461d-a048-566b6b8de579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Flow 'volume_create_manager' (ad571928-f559-4a61-80ae-7d442937a62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:11 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-87abb5ed-6375-4c51-96c1-21befa3f9723 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created volume successfully. Jun 25 18:22:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-quobyte-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44" acquired by "delete_volume" :: waited 0.050s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2754f3f2-f387-4f3f-aeff-9e39b67f1ad1]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:12 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 Jun 25 18:22:12 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:13 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e 1073741824" returned: 0 in 1.375s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:13 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e Jun 25 18:22:13 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:13 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44" returned: 0 in 1.075s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:13 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44 Jun 25 18:22:13 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:14 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e" returned: 0 in 0.967s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] <== create_volume: return (2407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.410s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.783s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1870268964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce0db73-7080-47fd-af3e-e38019d0d19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebadafdc6040b68f04be5133b8e119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:04Z,use_quota=True,user_id='ed310e784bfd491197e053cfcbaf90cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Creating volume 3ce0db73-7080-47fd-af3e-e38019d0d19b {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:14 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85988f58-f23e-47e0-91d6-552ba1d11c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:14 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b 1073741824 Jun 25 18:22:14 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cb02e7-4499-48e2-b22e-aea373a0bd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:14 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Volume volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e (41ef05c5-25f6-4abf-9f7d-ed40b6a8701e): created successfully Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cb02e7-4499-48e2-b22e-aea373a0bd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Flow 'volume_create_manager' (492dda49-cc23-497c-8edc-e40e9c3ea16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:14 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-559464c9-1945-45df-8747-93f5bc7d1e4b tempest-TestServerVolumeAttachmentScenario-482604943 None] Created volume successfully. Jun 25 18:22:14 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44" returned: 0 in 0.879s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44" released by "delete_volume" :: held 2.028s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created reservations ['1cc2c125-f74c-4bf9-a6fe-dd1bb618c66c', 'ba07f28b-e22a-4b9b-9b98-849af0a94575', 'f283cc1c-0193-4b18-bb85-18537b56a408', 'f8a1a43f-3e5b-40ea-8359-9dfae5664828'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:14 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:14 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:15 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-23785aab-0ca7-43a6-bc69-f45d608bea3a-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b 1073741824" returned: 0 in 1.729s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-23785aab-0ca7-43a6-bc69-f45d608bea3a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:15 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b Jun 25 18:22:15 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-quobyte-23785aab-0ca7-43a6-bc69-f45d608bea3a" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-23785aab-0ca7-43a6-bc69-f45d608bea3a" acquired by "delete_volume" :: waited 0.042s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:16 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:16 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4bb7d5-8e50-409c-8bab-d7b60d9c71af]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.397s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:16 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:16 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Deleted volume successfully. Jun 25 18:22:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a5b3294a-a880-4722-a2b4-e129e23da644 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-0dd58d3e-d360-4b5a-b51d-8f8b94b26d44-delete_volume" released by "delete_volume" :: held 3.879s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:16 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a Jun 25 18:22:16 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:17 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a" returned: 0 in 1.320s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:17 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a Jun 25 18:22:17 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:17 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b" returned: 0 in 1.539s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] <== create_volume: return (3358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.368s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a9c692-493d-40cb-8fc7-6b3ea6eb5579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce0db73-7080-47fd-af3e-e38019d0d19b', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1906902-23db-4e84-a08f-b3495bd4035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:17 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Volume volume-3ce0db73-7080-47fd-af3e-e38019d0d19b (3ce0db73-7080-47fd-af3e-e38019d0d19b): created successfully Jun 25 18:22:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1906902-23db-4e84-a08f-b3495bd4035a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Flow 'volume_create_manager' (472039c1-08df-4b75-a0e7-4bf47659de00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-09de32ec-1b42-48ab-a48a-2764aea1dffa tempest-TestServerVolumeAttachmentScenario-482604943 None] Created volume successfully. Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "cinder-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "cinder-quobyte-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-quobyte-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33" acquired by "delete_volume" :: waited 0.024s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a89276-00f0-4077-8d14-4acc5e218797]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:18 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 Jun 25 18:22:18 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:18 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-23785aab-0ca7-43a6-bc69-f45d608bea3a" returned: 0 in 0.965s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-23785aab-0ca7-43a6-bc69-f45d608bea3a" released by "delete_volume" :: held 2.359s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created reservations ['672eb808-b027-45e5-940a-0ac53a82ab0b', 'e38cf712-695f-4caf-8038-a35d4b8f732d', '5a604cb2-b510-42a6-8b4a-9b1bfd4898d7', '1aa28b85-bbbe-4ed5-87fc-304bb7e08c9c'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:18 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:18 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:19 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33" returned: 0 in 0.974s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:19 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33 Jun 25 18:22:19 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:19 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.819s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:19 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Deleted volume successfully. Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8e8bcba4-1018-444d-95d1-0e7878a6ad64 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-23785aab-0ca7-43a6-bc69-f45d608bea3a-delete_volume" released by "delete_volume" :: held 3.544s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-quobyte-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d41348-42f7-4b27-8b90-1903e924fe8e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:19 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe Jun 25 18:22:19 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:20 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33" returned: 0 in 0.844s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-quobyte-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33" released by "delete_volume" :: held 1.887s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Created reservations ['31690576-2d13-4a2f-abaa-9be9fabc6fcd', '0507cc6c-ece9-4a52-a61a-7d547330f6c6', 'd18677ae-1601-4ca9-86a0-b794b4799cb2', '212dafc5-17c6-4265-b4a0-ccb4bd3e4ba1'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:20 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:20 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "cinder-04549bdb-4dd6-46aa-846f-b393af41a5bf-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-04549bdb-4dd6-46aa-846f-b393af41a5bf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "cinder-quobyte-04549bdb-4dd6-46aa-846f-b393af41a5bf" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-quobyte-04549bdb-4dd6-46aa-846f-b393af41a5bf" acquired by "delete_volume" :: waited 0.038s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0539e38-d22f-490d-8da3-65bf832c85f1]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:20 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe" returned: 0 in 1.175s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:20 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe Jun 25 18:22:20 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:20 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf Jun 25 18:22:20 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:21 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.095s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:21 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:21 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Deleted volume successfully. Jun 25 18:22:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a252362f-57af-40e5-86d0-977a85c4026b tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-893a1f0d-9eaf-49da-8e8e-6bf6fc3dac33-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:21 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe" returned: 0 in 1.019s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe" released by "delete_volume" :: held 2.248s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf" returned: 0 in 1.143s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:21 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:21 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf Jun 25 18:22:21 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:21 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created reservations ['dce69995-db89-4e61-83c2-ed8487171f95', 'b202f082-8ea5-4249-b53a-a18eecf3ec86', '9277006c-50e6-4d68-8e7a-5fe1cd0ad162', '30a10580-d273-4a9f-88ee-57ad5d0dec58'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:22 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:22 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:22 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-04549bdb-4dd6-46aa-846f-b393af41a5bf" returned: 0 in 0.937s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-quobyte-04549bdb-4dd6-46aa-846f-b393af41a5bf" released by "delete_volume" :: held 2.148s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:22 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Created reservations ['0594281d-6ced-4f89-bd59-243a827e4257', '15191c8c-689b-4ea9-a584-b830daf76ecd', '3da2bb33-0fee-4cb8-85db-06320e135405', '9418f775-8615-4052-a4a2-bd769db9bde3'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-0b54e6bc-a155-478b-806e-e7d667983aa8-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:23 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.015s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-0b54e6bc-a155-478b-806e-e7d667983aa8-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Deleted volume successfully. Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:23 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:23 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2c1e64cb-9e6c-4d17-83ed-0392bca3001b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-4b63dd16-cbcf-4bf6-b0d0-2aa7612a24fe-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-quobyte-0b54e6bc-a155-478b-806e-e7d667983aa8" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-0b54e6bc-a155-478b-806e-e7d667983aa8" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[81029f5c-b011-4600-8847-6f0cbf7648f6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:23 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8 Jun 25 18:22:23 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:24 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.065s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:24 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Deleted volume successfully. Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-60a8b867-e5e6-4da7-b623-6f3038f0f121 tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-04549bdb-4dd6-46aa-846f-b393af41a5bf-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "cinder-18b59043-909b-4287-b5ae-df5783fb50df-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-18b59043-909b-4287-b5ae-df5783fb50df-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "cinder-quobyte-18b59043-909b-4287-b5ae-df5783fb50df" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-quobyte-18b59043-909b-4287-b5ae-df5783fb50df" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:24 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c590dc-43ff-49b2-a54b-fecb02114704]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8" returned: 0 in 1.367s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:24 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8 Jun 25 18:22:24 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:24 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df Jun 25 18:22:24 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:26 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0b54e6bc-a155-478b-806e-e7d667983aa8" returned: 0 in 1.483s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-0b54e6bc-a155-478b-806e-e7d667983aa8" released by "delete_volume" :: held 2.929s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created reservations ['87f56c6d-dbb7-4b7f-b96a-907bf122f705', '9d919890-9cab-4580-84e2-479fbb339976', 'efe070ac-24e1-42b2-9e7f-da462612490c', 'a08a18a2-ffda-40b7-a177-845b4c8227f1'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:26 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df" returned: 0 in 1.657s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:26 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df Jun 25 18:22:26 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:26 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:26 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-2b204863-2d34-421f-976e-08d0d68aa4ec-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-2b204863-2d34-421f-976e-08d0d68aa4ec-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-quobyte-2b204863-2d34-421f-976e-08d0d68aa4ec" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-2b204863-2d34-421f-976e-08d0d68aa4ec" acquired by "delete_volume" :: waited 0.056s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:27 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0c3298-3492-49c3-9bfb-3576050a093b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:27 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec Jun 25 18:22:27 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:27 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.124s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:27 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:27 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Deleted volume successfully. Jun 25 18:22:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-56b7e310-70b6-4ec5-a2eb-d5d010bc42e8 tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-0b54e6bc-a155-478b-806e-e7d667983aa8-delete_volume" released by "delete_volume" :: held 4.492s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:27 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18b59043-909b-4287-b5ae-df5783fb50df" returned: 0 in 1.546s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-quobyte-18b59043-909b-4287-b5ae-df5783fb50df" released by "delete_volume" :: held 3.330s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:27 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Created reservations ['198939a2-257b-4786-8d12-f8bb8b214248', 'c50833f3-1eb1-404f-bb78-913e1d1e5ad9', '7bb26005-ddcb-45c0-8d5e-abaaec44238d', 'db39d876-12cc-42ad-8670-f0066c9ee19e'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:28 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:28 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:28 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec" returned: 0 in 1.540s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:28 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec Jun 25 18:22:28 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:29 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.031s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Deleted volume successfully. Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d3803c3e-f11c-477d-b121-a7828a0fed2c tempest-AttachVolumeTestJSON-1045690878 None] Lock "cinder-18b59043-909b-4287-b5ae-df5783fb50df-delete_volume" released by "delete_volume" :: held 4.747s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Flow 'volume_create_manager' (a25f61fd-6f79-46e9-af48-9c27641e2add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414bff00-4652-4de7-a7ea-639ddca2f1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414bff00-4652-4de7-a7ea-639ddca2f1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1974777360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b4327-3d0e-44fc-b08c-bdf2564bf81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbef106c4ac04c39a683018cd5b0788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:30Z,use_quota=True,user_id='7c8b528bd92844128db1fc9f5dff75c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e239e3fb-82fa-4e24-b995-59fe17522885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e239e3fb-82fa-4e24-b995-59fe17522885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fdd398-eac0-4376-8e2b-46f989acb73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fdd398-eac0-4376-8e2b-46f989acb73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0b4327-3d0e-44fc-b08c-bdf2564bf81e', 'volume_name': 'volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a12027-3c9c-4960-88aa-53af9fd0737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a12027-3c9c-4960-88aa-53af9fd0737f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b0a617-e0b5-4740-a36c-be07a69bdc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:29 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Volume 3e0b4327-3d0e-44fc-b08c-bdf2564bf81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e', 'volume_size': 1} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1974777360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b4327-3d0e-44fc-b08c-bdf2564bf81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbef106c4ac04c39a683018cd5b0788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:30Z,use_quota=True,user_id='7c8b528bd92844128db1fc9f5dff75c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Creating volume 3e0b4327-3d0e-44fc-b08c-bdf2564bf81e {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:30 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:30 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:30 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e 1073741824 Jun 25 18:22:30 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b204863-2d34-421f-976e-08d0d68aa4ec" returned: 0 in 1.332s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-2b204863-2d34-421f-976e-08d0d68aa4ec" released by "delete_volume" :: held 3.038s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created reservations ['67a70ed1-0a36-412c-8558-26f8242cff38', '3c536147-a532-4eb5-be94-1fe1ee2df6f6', '4f14562c-c978-4482-aa69-ac92aaca0a65', 'a91b4697-239e-4384-90c4-6a429e8a9728'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:30 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:30 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-e982cd2b-9295-49ac-85bc-8c800337df66-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-e982cd2b-9295-49ac-85bc-8c800337df66-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "cinder-quobyte-e982cd2b-9295-49ac-85bc-8c800337df66" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-e982cd2b-9295-49ac-85bc-8c800337df66" acquired by "delete_volume" :: waited 0.045s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[660450d3-86e6-4e3f-9562-b0f2f5ed6619]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:30 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66 Jun 25 18:22:30 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:31 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.977s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:31 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Deleted volume successfully. Jun 25 18:22:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0185c6b0-d5ce-4bda-9124-1d6b64c6220b tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-2b204863-2d34-421f-976e-08d0d68aa4ec-delete_volume" released by "delete_volume" :: held 4.488s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:31 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e 1073741824" returned: 0 in 1.772s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:31 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e Jun 25 18:22:31 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:32 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66" returned: 0 in 1.629s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:32 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66 Jun 25 18:22:32 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:32 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e" returned: 0 in 0.860s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] <== create_volume: return (2721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.726s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b0a617-e0b5-4740-a36c-be07a69bdc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ba5872-2a68-4d46-84c7-e8e3fc31ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:32 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Volume volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e (3e0b4327-3d0e-44fc-b08c-bdf2564bf81e): created successfully Jun 25 18:22:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ba5872-2a68-4d46-84c7-e8e3fc31ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Flow 'volume_create_manager' (a25f61fd-6f79-46e9-af48-9c27641e2add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:32 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-339f4cc1-a7eb-4152-a860-388dc86650a5 tempest-VolumesListAdminTestJSON-1573472031 None] Created volume successfully. Jun 25 18:22:33 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e982cd2b-9295-49ac-85bc-8c800337df66" returned: 0 in 0.846s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-quobyte-e982cd2b-9295-49ac-85bc-8c800337df66" released by "delete_volume" :: held 2.570s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:33 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Created reservations ['e2847116-6102-4f06-8070-639fce19f151', '962456b7-43db-49c8-84ad-d7f352d65af3', 'c10f60d3-7894-420b-9a6c-e279af46d436', '17772e53-6c83-415c-b4e4-41a98f2d47a6'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:33 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:33 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Flow 'volume_create_manager' (386c4c1c-81c9-457c-9c60-f55cd77431e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06903f2-d7b3-4857-8e60-deba1b10d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06903f2-d7b3-4857-8e60-deba1b10d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1821651343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07afe530-5346-41bc-a04e-5420c631c499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbef106c4ac04c39a683018cd5b0788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:34Z,use_quota=True,user_id='7c8b528bd92844128db1fc9f5dff75c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7034ffa4-c17a-462e-85a0-a8d8c5bf39e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7034ffa4-c17a-462e-85a0-a8d8c5bf39e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca20088-e28e-4134-bc39-2ee080b68ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca20088-e28e-4134-bc39-2ee080b68ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07afe530-5346-41bc-a04e-5420c631c499', 'volume_name': 'volume-07afe530-5346-41bc-a04e-5420c631c499', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69c0ed0-e9bd-4a4d-bdcf-2b43d6a188a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69c0ed0-e9bd-4a4d-bdcf-2b43d6a188a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e88cd3-8834-4e44-8f2c-548b35afb3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:34 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Volume 07afe530-5346-41bc-a04e-5420c631c499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07afe530-5346-41bc-a04e-5420c631c499', 'volume_size': 1} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1821651343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07afe530-5346-41bc-a04e-5420c631c499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbef106c4ac04c39a683018cd5b0788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:34Z,use_quota=True,user_id='7c8b528bd92844128db1fc9f5dff75c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Creating volume 07afe530-5346-41bc-a04e-5420c631c499 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:34 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:34 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499 1073741824 Jun 25 18:22:34 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:34 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.288s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:34 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Deleted volume successfully. Jun 25 18:22:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0a657a15-f5c1-4176-a72b-ceb98f8e5cdf tempest-CreateVolumesFromSourceVolumeTest-808843577 None] Lock "cinder-e982cd2b-9295-49ac-85bc-8c800337df66-delete_volume" released by "delete_volume" :: held 4.331s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:35 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499 1073741824" returned: 0 in 1.445s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:36 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499 Jun 25 18:22:36 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:37 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499" returned: 0 in 1.027s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] <== create_volume: return (2626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.634s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e88cd3-8834-4e44-8f2c-548b35afb3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07afe530-5346-41bc-a04e-5420c631c499', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b86ba-5c14-4272-91fe-a584d264c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:37 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Volume volume-07afe530-5346-41bc-a04e-5420c631c499 (07afe530-5346-41bc-a04e-5420c631c499): created successfully Jun 25 18:22:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b86ba-5c14-4272-91fe-a584d264c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Flow 'volume_create_manager' (386c4c1c-81c9-457c-9c60-f55cd77431e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-eff21370-a47e-495e-bacc-d8964e251714 tempest-VolumesListAdminTestJSON-1573472031 None] Created volume successfully. Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Flow 'volume_create_manager' (aa160f6b-63f3-4814-b79f-d45c06e325e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae3c921-16e5-48e0-99c6-0c2222f8c4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae3c921-16e5-48e0-99c6-0c2222f8c4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-520919843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09260c21-79c8-4368-be03-78a1712ac9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbef106c4ac04c39a683018cd5b0788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:38Z,use_quota=True,user_id='7c8b528bd92844128db1fc9f5dff75c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf996e9-a57e-4b52-9250-31c8ea433618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf996e9-a57e-4b52-9250-31c8ea433618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53904777-2e77-4639-b47c-96040dfb3778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53904777-2e77-4639-b47c-96040dfb3778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09260c21-79c8-4368-be03-78a1712ac9ea', 'volume_name': 'volume-09260c21-79c8-4368-be03-78a1712ac9ea', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c70826b-46be-49e8-bb39-0d4fc92a2c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c70826b-46be-49e8-bb39-0d4fc92a2c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98816777-85cb-48c5-b2a3-6c98626c530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:38 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Volume 09260c21-79c8-4368-be03-78a1712ac9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09260c21-79c8-4368-be03-78a1712ac9ea', 'volume_size': 1} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-520919843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09260c21-79c8-4368-be03-78a1712ac9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbef106c4ac04c39a683018cd5b0788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:38Z,use_quota=True,user_id='7c8b528bd92844128db1fc9f5dff75c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Creating volume 09260c21-79c8-4368-be03-78a1712ac9ea {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:38 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:38 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea 1073741824 Jun 25 18:22:38 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:39 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea 1073741824" returned: 0 in 1.132s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:39 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea Jun 25 18:22:39 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:40 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea" returned: 0 in 0.723s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98816777-85cb-48c5-b2a3-6c98626c530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09260c21-79c8-4368-be03-78a1712ac9ea', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9499552-a799-44f4-a086-1017194c8cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:40 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Volume volume-09260c21-79c8-4368-be03-78a1712ac9ea (09260c21-79c8-4368-be03-78a1712ac9ea): created successfully Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9499552-a799-44f4-a086-1017194c8cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Flow 'volume_create_manager' (aa160f6b-63f3-4814-b79f-d45c06e325e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:40 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ef8200c5-e55c-4b83-8edf-9fe095acc083 tempest-VolumesListAdminTestJSON-1573472031 None] Created volume successfully. Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:40 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:40 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:41 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.699s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:22:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:22:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Flow 'volume_create_manager' (59089806-7359-476e-9838-f6cc02a489de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca253e7-164b-4c65-ad2e-84aa95c72b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca253e7-164b-4c65-ad2e-84aa95c72b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f1298b-3f11-4b1e-8dd3-e82b9b74d780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ec9619bec4b628587b39fca542a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:42Z,use_quota=True,user_id='760557edd189412a8fa44124ec427630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d34c69-af93-46ee-9633-c51958ce2336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d34c69-af93-46ee-9633-c51958ce2336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f172525-df03-48e5-99c5-d6ef69b39722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f172525-df03-48e5-99c5-d6ef69b39722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f1298b-3f11-4b1e-8dd3-e82b9b74d780', 'volume_name': 'volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040c0bcc-e073-4aca-b9d0-06aa96b83227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040c0bcc-e073-4aca-b9d0-06aa96b83227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb29b209-d610-4bfe-87d7-8ba68b653cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:42 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Volume e9f1298b-3f11-4b1e-8dd3-e82b9b74d780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780', 'volume_size': 1} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f1298b-3f11-4b1e-8dd3-e82b9b74d780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ec9619bec4b628587b39fca542a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:42Z,use_quota=True,user_id='760557edd189412a8fa44124ec427630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Creating volume e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:42 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:42 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 1073741824 Jun 25 18:22:42 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:43 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 1073741824" returned: 0 in 1.029s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:43 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 Jun 25 18:22:43 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:44 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780" returned: 0 in 0.735s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb29b209-d610-4bfe-87d7-8ba68b653cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495c5190-fd53-4f64-a2d3-0a1bdcedad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:44 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Volume volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 (e9f1298b-3f11-4b1e-8dd3-e82b9b74d780): created successfully Jun 25 18:22:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495c5190-fd53-4f64-a2d3-0a1bdcedad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Flow 'volume_create_manager' (59089806-7359-476e-9838-f6cc02a489de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ae38aca6-2c59-48ea-a4d0-37175cd84009 tempest-VolumesListAdminTestJSON-38244269 None] Created volume successfully. Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Acquiring lock "cinder-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Lock "cinder-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Acquiring lock "cinder-quobyte-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Lock "cinder-quobyte-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b3899d54-1ccb-410b-8907-70d2ed429600 tempest-GroupSnapshotsV319Test-1555566386 None] Group tempest-GroupSnapshotsV319Test-Group-175680954: creating Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[457aaab6-a24e-441d-b2c2-de5a72266045]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b3899d54-1ccb-410b-8907-70d2ed429600 tempest-GroupSnapshotsV319Test-1555566386 None] Group tempest-GroupSnapshotsV319Test-Group-175680954: created successfully Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "cinder-09260c21-79c8-4368-be03-78a1712ac9ea-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b3899d54-1ccb-410b-8907-70d2ed429600 tempest-GroupSnapshotsV319Test-1555566386 None] Create group completed successfully. Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-09260c21-79c8-4368-be03-78a1712ac9ea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "cinder-quobyte-09260c21-79c8-4368-be03-78a1712ac9ea" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-quobyte-09260c21-79c8-4368-be03-78a1712ac9ea" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:45 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 Jun 25 18:22:45 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8361591-813f-4cda-8382-e6d30ac37c1e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:46 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea Jun 25 18:22:46 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:46 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780" returned: 0 in 0.888s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:46 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780 Jun 25 18:22:46 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:46 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea" returned: 0 in 0.951s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:46 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea Jun 25 18:22:46 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:47 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780" returned: 0 in 1.019s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Lock "cinder-quobyte-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780" released by "delete_volume" :: held 2.006s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:47 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-09260c21-79c8-4368-be03-78a1712ac9ea" returned: 0 in 0.865s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Flow 'volume_create_manager' (04aad61e-6a10-49f1-83ae-9762b4920860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25fa76d-6d2d-497b-b50f-2a9714339124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-quobyte-09260c21-79c8-4368-be03-78a1712ac9ea" released by "delete_volume" :: held 1.904s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25fa76d-6d2d-497b-b50f-2a9714339124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2147122809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b0e8289-f336-42b0-b6f0-389c0166ae67,host='devstack@QuobyteHD#QuobyteHD',id=58fff0e5-0be8-4a4f-a41b-01680c1f589f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade40021d9a9440e85b9cde5bf02413e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:48Z,use_quota=True,user_id='3927233ef62c4b009fe760eca197f1b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(115baea0-119f-4570-90d1-38b6f9ed01b2),volume_type_id=115baea0-119f-4570-90d1-38b6f9ed01b2)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177ab8d0-aab8-4323-a9a2-6c92164ae3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177ab8d0-aab8-4323-a9a2-6c92164ae3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda203c-cd38-432e-820c-0a83ff5cdfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda203c-cd38-432e-820c-0a83ff5cdfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58fff0e5-0be8-4a4f-a41b-01680c1f589f', 'volume_name': 'volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb9604a-8bd6-40e3-97d9-578450a18cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb9604a-8bd6-40e3-97d9-578450a18cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30609c9-c1f4-4c8e-abb6-fa427256cd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:47 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Volume 58fff0e5-0be8-4a4f-a41b-01680c1f589f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f', 'volume_size': 1} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3b0e8289-f336-42b0-b6f0-389c0166ae67,created_at=2026-06-25T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2147122809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b0e8289-f336-42b0-b6f0-389c0166ae67,host='devstack@QuobyteHD#QuobyteHD',id=58fff0e5-0be8-4a4f-a41b-01680c1f589f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade40021d9a9440e85b9cde5bf02413e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:48Z,use_quota=True,user_id='3927233ef62c4b009fe760eca197f1b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(115baea0-119f-4570-90d1-38b6f9ed01b2),volume_type_id=115baea0-119f-4570-90d1-38b6f9ed01b2)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Creating volume 58fff0e5-0be8-4a4f-a41b-01680c1f589f {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:47 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:47 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f 1073741824 Jun 25 18:22:47 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:47 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Created reservations ['4786aee0-303f-4752-8f2b-da54498cf40d', 'b0fc93f4-7839-4fdb-ad2d-59f975cfbe38', '8d78f28a-6295-4afc-ad4f-7a0b98304e10', 'a765ce0e-9938-439f-9dad-93a29ac28f78'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Created reservations ['4b285da3-7f20-4bcc-a643-0e43199674dd', '19ad19e8-0c39-4279-8900-54190554a788', '2ff1905c-6795-4351-87af-e0e73e503a64', '8916552f-50ee-4092-a727-3df689f36b8e'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:48 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:48 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:48 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:48 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:48 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.802s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:48 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:48 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Deleted volume successfully. Jun 25 18:22:48 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.798s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:49 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Deleted volume successfully. Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2925d5e4-b7bf-454e-b29f-a7dbad7b5831 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-09260c21-79c8-4368-be03-78a1712ac9ea-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:49 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f 1073741824" returned: 0 in 1.189s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-79c200d2-5946-44a2-a16c-35115233cb95 tempest-VolumesListAdminTestJSON-38244269 None] Lock "cinder-e9f1298b-3f11-4b1e-8dd3-e82b9b74d780-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:49 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f Jun 25 18:22:49 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "cinder-07afe530-5346-41bc-a04e-5420c631c499-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-07afe530-5346-41bc-a04e-5420c631c499-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "cinder-quobyte-07afe530-5346-41bc-a04e-5420c631c499" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-quobyte-07afe530-5346-41bc-a04e-5420c631c499" acquired by "delete_volume" :: waited 0.033s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[df262194-7edc-4c60-90b7-1e77c627b403]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:49 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499 Jun 25 18:22:49 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:49 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f" returned: 0 in 0.689s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30609c9-c1f4-4c8e-abb6-fa427256cd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f50621-9d14-4afb-8201-c1eee27b76a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:49 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Volume volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f (58fff0e5-0be8-4a4f-a41b-01680c1f589f): created successfully Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f50621-9d14-4afb-8201-c1eee27b76a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Flow 'volume_create_manager' (04aad61e-6a10-49f1-83ae-9762b4920860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:49 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-52227cd9-3b52-4017-a15c-24651a3e80c4 tempest-GroupSnapshotsV319Test-1555566386 None] Created volume successfully. Jun 25 18:22:50 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499" returned: 0 in 0.832s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:50 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499 Jun 25 18:22:50 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:50 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] GroupSnapshot aa6cba2a-17cc-4d82-8310-a1583b6e8336: creating. Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Group snapshot aa6cba2a-17cc-4d82-8310-a1583b6e8336: creating. {{(pid=93767) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4755}} Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Creating offline snapshot c67e108f-1470-4ab2-ac14-7328e39fa5ab of volume 58fff0e5-0be8-4a4f-a41b-01680c1f589f {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[0476fce3-5946-4a31-a599-1412f7389763]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:50 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f Jun 25 18:22:50 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:50 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-07afe530-5346-41bc-a04e-5420c631c499" returned: 0 in 0.708s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-quobyte-07afe530-5346-41bc-a04e-5420c631c499" released by "delete_volume" :: held 1.603s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Created reservations ['9e78545f-1fbc-4a62-b3d6-a75706018267', 'cfdf3244-dad4-469e-8518-b7929fbc4818', '7c405fb5-836d-4104-b3fe-f5a174642ae2', 'ee2b1f84-c473-467e-8485-b1e5e258b45b'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:51 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:51 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:51 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f" returned: 0 in 1.056s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "cinder-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:51 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab 1G Jun 25 18:22:51 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "cinder-quobyte-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-quobyte-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e" acquired by "delete_volume" :: waited 0.024s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b28b91-210e-42d3-b7f1-10bbc00c0f8e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:52 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.869s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:52 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:52 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Deleted volume successfully. Jun 25 18:22:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-649ce026-c989-43e8-89bd-9b124ba5e4f2 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-07afe530-5346-41bc-a04e-5420c631c499-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:52 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e Jun 25 18:22:52 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:52 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab 1G" returned: 0 in 0.999s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:52 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab Jun 25 18:22:52 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:52 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e" returned: 0 in 0.931s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:52 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e Jun 25 18:22:52 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:53 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab" returned: 0 in 0.756s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:53 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:53 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab Jun 25 18:22:53 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:53 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e" returned: 0 in 0.711s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-quobyte-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e" released by "delete_volume" :: held 1.701s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Created reservations ['7cc29ae6-9203-4ca3-8946-8464eb84aaa5', '0d4f8aec-092f-48a1-ab34-908e2a092df1', 'de7e532d-3944-403f-8209-d772e3fd19e3', 'ebb49d6c-1286-43bf-9b15-b1f90e0235fc'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:53 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:22:53 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:54 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab" returned: 0 in 0.728s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:54 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.info Jun 25 18:22:54 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:54 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.785s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:54 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:54 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Deleted volume successfully. Jun 25 18:22:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-031cb7b3-da21-4a2f-acbd-53740f178106 tempest-VolumesListAdminTestJSON-1573472031 None] Lock "cinder-3e0b4327-3d0e-44fc-b08c-bdf2564bf81e-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:55 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.info" returned: 0 in 0.791s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:55 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:22:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:55 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.info Jun 25 18:22:55 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:55 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.info" returned: 0 in 0.797s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.241s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-76c32bfe-d884-4387-97cd-28a10e860734 req-e49976e7-281d-40ec-938c-641a982e2dd4 tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-76c32bfe-d884-4387-97cd-28a10e860734 req-e49976e7-281d-40ec-938c-641a982e2dd4 tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:55 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec836663-8183-4031-94b8-64fda204360e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-76c32bfe-d884-4387-97cd-28a10e860734 req-e49976e7-281d-40ec-938c-641a982e2dd4 tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:56 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d4d34dd0-a9da-4a10-90db-f791b2f04772 tempest-GroupSnapshotsV319Test-1555566386 None] group_snapshot aa6cba2a-17cc-4d82-8310-a1583b6e8336: created successfully Jun 25 18:22:56 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e Jun 25 18:22:56 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:56 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-76c32bfe-d884-4387-97cd-28a10e860734 req-e49976e7-281d-40ec-938c-641a982e2dd4 tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e" returned: 0 in 0.925s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-76c32bfe-d884-4387-97cd-28a10e860734 req-e49976e7-281d-40ec-938c-641a982e2dd4 tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-76c32bfe-d884-4387-97cd-28a10e860734 req-e49976e7-281d-40ec-938c-641a982e2dd4 tempest-TestServerVolumeAttachmentScenario-482604943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a623474f-d1cb-4ee1-9074-55ffce4b6586', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:22:57 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-76c32bfe-d884-4387-97cd-28a10e860734 req-e49976e7-281d-40ec-938c-641a982e2dd4 tempest-TestServerVolumeAttachmentScenario-482604943 None] attachment_update completed successfully. Jun 25 18:22:57 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] group_snapshot aa6cba2a-17cc-4d82-8310-a1583b6e8336: deleting Jun 25 18:22:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] group_snapshot aa6cba2a-17cc-4d82-8310-a1583b6e8336: deleting {{(pid=93767) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4930}} Jun 25 18:22:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Acquiring lock "cinder-quobyte-58fff0e5-0be8-4a4f-a41b-01680c1f589f" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "cinder-quobyte-58fff0e5-0be8-4a4f-a41b-01680c1f589f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Acquiring lock "cinder-quobyte-c67e108f-1470-4ab2-ac14-7328e39fa5ab" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "cinder-quobyte-c67e108f-1470-4ab2-ac14-7328e39fa5ab" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Deleting offline snapshot c67e108f-1470-4ab2-ac14-7328e39fa5ab of volume 58fff0e5-0be8-4a4f-a41b-01680c1f589f {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:22:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] snapshot_file for this snap is: volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:22:57 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d29037-93ea-427b-8077-c1ffc50d03e9]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:57 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab Jun 25 18:22:57 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:58 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab" returned: 0 in 0.868s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:22:58 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[758bf992-015e-4014-897c-b25fe92819e0]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:58 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f Jun 25 18:22:58 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:59 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f" returned: 0 in 0.864s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:59 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab Jun 25 18:22:59 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:00 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab" returned: 0 in 0.913s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:00 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab Jun 25 18:23:00 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:01 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f.c67e108f-1470-4ab2-ac14-7328e39fa5ab" returned: 0 in 0.732s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:01 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "cinder-quobyte-c67e108f-1470-4ab2-ac14-7328e39fa5ab" released by "_delete_snapshot" :: held 3.547s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:01 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "cinder-quobyte-58fff0e5-0be8-4a4f-a41b-01680c1f589f" released by "delete_snapshot" :: held 3.581s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:01 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=97,cinder:UPDATE=151,cinder:DELETE=12,cinder:INSERT=32 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:23:01 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=115,cinder:UPDATE=139,cinder:INSERT=33,cinder:DELETE=14 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:23:01 devstack cinder-volume[93767]: WARNING cinder.quota [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2088974207 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2088974207, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:23:01 devstack cinder-volume[93767]: WARNING cinder.quota [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2088974207 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2088974207, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:23:01 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] Created reservations ['e02112ea-92cf-475b-9521-39ece7bd9b39', '71aa7d6b-ec5d-4a52-ace0-512198b5b94c', '923bb871-2d94-4235-bf52-cf34130abc6b', '0be44470-dbff-40f2-a691-75cccdfeb3c9'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:01 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-59e7dbe1-0acb-4299-ba2a-d60ade80e671 tempest-GroupSnapshotsV319Test-1555566386 None] group_snapshot aa6cba2a-17cc-4d82-8310-a1583b6e8336: deleted successfully Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Flow 'volume_create_manager' (5ef4a543-25ef-4517-9083-af68953b9e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38867b0-267a-481d-a088-43c64b0e89f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38867b0-267a-481d-a088-43c64b0e89f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1625655316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9569f9d4-8867-4b8e-af58-2575705fb7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4497483a0f4b879a0071e41ce62300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:02Z,use_quota=True,user_id='5dc262205fed4f10abd9d4d0a0c2b02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68981605-ead2-4eb0-8d49-ca6b613053c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68981605-ead2-4eb0-8d49-ca6b613053c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72266429-4d4e-467b-9ccc-19a0a9ef99de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72266429-4d4e-467b-9ccc-19a0a9ef99de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9569f9d4-8867-4b8e-af58-2575705fb7d6', 'volume_name': 'volume-9569f9d4-8867-4b8e-af58-2575705fb7d6', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f8cbfe-1c98-4461-a4ef-7f410480efda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f8cbfe-1c98-4461-a4ef-7f410480efda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44edc89-2d34-4895-87d8-0ab2425522fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:02 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Volume 9569f9d4-8867-4b8e-af58-2575705fb7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9569f9d4-8867-4b8e-af58-2575705fb7d6', 'volume_size': 1} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1625655316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9569f9d4-8867-4b8e-af58-2575705fb7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4497483a0f4b879a0071e41ce62300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:02Z,use_quota=True,user_id='5dc262205fed4f10abd9d4d0a0c2b02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Creating volume 9569f9d4-8867-4b8e-af58-2575705fb7d6 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:02 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:02 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 1073741824 Jun 25 18:23:02 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Acquiring lock "cinder-quobyte-58fff0e5-0be8-4a4f-a41b-01680c1f589f" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "cinder-quobyte-58fff0e5-0be8-4a4f-a41b-01680c1f589f" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[57870cdc-c48d-4f55-b4ae-cf3d0d5c3065]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:02 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f Jun 25 18:23:02 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:03 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 1073741824" returned: 0 in 1.030s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:03 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:03 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 Jun 25 18:23:03 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f" returned: 0 in 0.931s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:03 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f Jun 25 18:23:03 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:04 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6" returned: 0 in 0.718s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44edc89-2d34-4895-87d8-0ab2425522fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9569f9d4-8867-4b8e-af58-2575705fb7d6', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cdf354-85f0-40ec-bd4a-c7a640b30d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:04 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Volume volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 (9569f9d4-8867-4b8e-af58-2575705fb7d6): created successfully Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cdf354-85f0-40ec-bd4a-c7a640b30d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Flow 'volume_create_manager' (5ef4a543-25ef-4517-9083-af68953b9e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-01418be8-1c8c-475a-93dd-7bbdae629d3e tempest-SnapshotMetadataTestJSON-966198563 None] Created volume successfully. Jun 25 18:23:04 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-58fff0e5-0be8-4a4f-a41b-01680c1f589f" returned: 0 in 0.783s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "cinder-quobyte-58fff0e5-0be8-4a4f-a41b-01680c1f589f" released by "delete_volume" :: held 1.812s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Created reservations ['c74b5a5c-b348-4ca9-aeda-52f93ff9cd08'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:04 devstack cinder-volume[93767]: WARNING cinder.quota [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2088974207 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2088974207, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Created reservations ['12de1ccd-a84e-4cff-ba55-b1338ca00cc3', '3200bde4-2032-4571-8148-8d6446dfe847', 'b9de8263-7a1f-4ae1-8ca6-799227f14650', '091b0685-bb51-43d2-8d67-2d7c39ea066e'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:04 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:23:04 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Creating offline snapshot d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 of volume 9569f9d4-8867-4b8e-af58-2575705fb7d6 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d2d07b-330e-441f-a0fa-62d8e428bb17]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:05 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 Jun 25 18:23:05 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:05 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.782s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:05 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:05 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-969e47e4-6fbb-461f-a691-a78092db7697 tempest-GroupSnapshotsV319Test-1555566386 None] Delete group completed successfully. Jun 25 18:23:05 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6" returned: 0 in 0.883s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:05 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 1G Jun 25 18:23:05 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:06 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 1G" returned: 0 in 1.015s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:06 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 Jun 25 18:23:06 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-3b4962e3-6029-4199-9874-39717fb6222a req-888af7c6-7cb0-4b3d-b959-dc9a8ec0bf9e tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:07 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5" returned: 0 in 1.032s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:07 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 is being set with open permissions: ugo+rw Jun 25 18:23:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:07 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 Jun 25 18:23:07 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:08 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5" returned: 0 in 0.860s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:08 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.info Jun 25 18:23:08 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:09 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.info" returned: 0 in 0.851s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:09 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.info is being set with open permissions: ugo+rw Jun 25 18:23:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:09 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.info Jun 25 18:23:09 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:10 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.info" returned: 0 in 0.779s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.538s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-3b4962e3-6029-4199-9874-39717fb6222a req-888af7c6-7cb0-4b3d-b959-dc9a8ec0bf9e tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.642s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:10 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a43301-410c-4bef-94ad-d3e00306931c]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-3b4962e3-6029-4199-9874-39717fb6222a req-888af7c6-7cb0-4b3d-b959-dc9a8ec0bf9e tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-08b24430-7eed-4c62-861d-b9415c2d38a2 tempest-SnapshotMetadataTestJSON-966198563 None] Create snapshot completed successfully Jun 25 18:23:10 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b Jun 25 18:23:10 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:11 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-3b4962e3-6029-4199-9874-39717fb6222a req-888af7c6-7cb0-4b3d-b959-dc9a8ec0bf9e tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b" returned: 0 in 1.073s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-3b4962e3-6029-4199-9874-39717fb6222a req-888af7c6-7cb0-4b3d-b959-dc9a8ec0bf9e tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.107s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-3b4962e3-6029-4199-9874-39717fb6222a req-888af7c6-7cb0-4b3d-b959-dc9a8ec0bf9e tempest-TestServerVolumeAttachmentScenario-482604943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-3ce0db73-7080-47fd-af3e-e38019d0d19b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00dd617e-59f1-418c-a761-b63e92459cc3', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:23:11 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-3b4962e3-6029-4199-9874-39717fb6222a req-888af7c6-7cb0-4b3d-b959-dc9a8ec0bf9e tempest-TestServerVolumeAttachmentScenario-482604943 None] attachment_update completed successfully. Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Acquiring lock "cinder-d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Acquiring lock "cinder-quobyte-9569f9d4-8867-4b8e-af58-2575705fb7d6" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-quobyte-9569f9d4-8867-4b8e-af58-2575705fb7d6" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Acquiring lock "cinder-quobyte-d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-quobyte-d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Deleting offline snapshot d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 of volume 9569f9d4-8867-4b8e-af58-2575705fb7d6 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] snapshot_file for this snap is: volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[60afa367-4a68-45d6-ba91-9ff76daa67a1]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:12 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 Jun 25 18:23:12 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:13 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5" returned: 0 in 0.930s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9569f9d4-8867-4b8e-af58-2575705fb7d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:23:13 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[68253e59-8212-48fa-8305-2396212efc49]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:13 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 Jun 25 18:23:13 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:14 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6" returned: 0 in 1.031s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:14 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 Jun 25 18:23:14 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:15 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5" returned: 0 in 0.802s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:15 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5 Jun 25 18:23:15 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:16 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6.d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5" returned: 0 in 0.696s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-quobyte-d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5" released by "_delete_snapshot" :: held 3.618s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-quobyte-9569f9d4-8867-4b8e-af58-2575705fb7d6" released by "delete_snapshot" :: held 3.659s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Created reservations ['ab0677bb-abf4-4677-a3ff-95831252ec5f', '82f26ecd-ed58-43ce-9440-5939455f1b6e', '1db3d175-d6d0-46cb-87bf-582cfaeca521', 'ecbbb6f7-988a-499d-81bd-4e15448aa5b6'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:16 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Delete snapshot completed successfully. Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5f260bfd-21f1-4696-a1d1-cbb1dd0a6fc4 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-d0b5417b-cf93-4ed4-bb76-c2e2bf3477d5-delete_snapshot" released by "delete_snapshot" :: held 3.881s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Acquiring lock "cinder-9569f9d4-8867-4b8e-af58-2575705fb7d6-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-9569f9d4-8867-4b8e-af58-2575705fb7d6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Acquiring lock "cinder-quobyte-9569f9d4-8867-4b8e-af58-2575705fb7d6" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-quobyte-9569f9d4-8867-4b8e-af58-2575705fb7d6" acquired by "delete_volume" :: waited 0.015s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:16 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba31234d-29ea-4276-b88e-76c9cf44a830]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:17 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 Jun 25 18:23:17 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1d913869-726b-4981-9888-58e4537aa18a tempest-GroupsV314Test-872326020 None] Group tempest-GroupsV314Test-Group-1398821797: creating Jun 25 18:23:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1d913869-726b-4981-9888-58e4537aa18a tempest-GroupsV314Test-872326020 None] Group tempest-GroupsV314Test-Group-1398821797: created successfully Jun 25 18:23:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1d913869-726b-4981-9888-58e4537aa18a tempest-GroupsV314Test-872326020 None] Create group completed successfully. Jun 25 18:23:17 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6" returned: 0 in 0.859s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:17 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6 Jun 25 18:23:17 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-08fd6d5a-1c8c-46fb-b46f-25996b29dfbb req-b6556059-74aa-49a4-b4e6-98bf61abe9ec tempest-TestServerVolumeAttachmentScenario-482604943 None] Terminate volume connection completed successfully. Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-08fd6d5a-1c8c-46fb-b46f-25996b29dfbb req-b6556059-74aa-49a4-b4e6-98bf61abe9ec tempest-TestServerVolumeAttachmentScenario-482604943 None] Deleting attachment 00dd617e-59f1-418c-a761-b63e92459cc3. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:23:18 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9569f9d4-8867-4b8e-af58-2575705fb7d6" returned: 0 in 0.664s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-quobyte-9569f9d4-8867-4b8e-af58-2575705fb7d6" released by "delete_volume" :: held 1.586s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Created reservations ['7a51ee9a-77ed-48dc-850a-331a1c78018b', '90f11e47-06d4-48f5-84be-7677b84fc1b7', '929d09e7-e13a-43ec-8d82-1870fb28b694', 'e50b5b0a-0ccc-4f76-9bf4-6e85f0a182d7'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:18 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:23:18 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:19 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.803s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:19 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Deleted volume successfully. Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5904b83b-ee2f-4583-966f-cc09f7d4a2a0 tempest-SnapshotMetadataTestJSON-966198563 None] Lock "cinder-9569f9d4-8867-4b8e-af58-2575705fb7d6-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Flow 'volume_create_manager' (5848ece6-35f5-470b-abe3-e2462427ffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e69b82-c05f-48b9-8015-feffb41f083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e69b82-c05f-48b9-8015-feffb41f083e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-840481035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61103750-3727-4077-bc7d-b60c162a1a83,host='devstack@QuobyteHD#QuobyteHD',id=f31bf413-3361-4c6c-b98c-6228e37c2be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24345a0073eb4f7fafb0a5b055dcd236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:19Z,use_quota=True,user_id='743c39dd692647789d4fec780a479281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da31cd0d-f1f1-4fd6-8403-90000c59834e),volume_type_id=da31cd0d-f1f1-4fd6-8403-90000c59834e)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf025327-2caf-44c3-8d38-541922eb9cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf025327-2caf-44c3-8d38-541922eb9cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833ead99-3bdd-4889-bc5b-e7807eba8d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833ead99-3bdd-4889-bc5b-e7807eba8d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f31bf413-3361-4c6c-b98c-6228e37c2be7', 'volume_name': 'volume-f31bf413-3361-4c6c-b98c-6228e37c2be7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996d7d02-0255-4cac-a5a7-935f481842b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996d7d02-0255-4cac-a5a7-935f481842b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f76e27d-4af6-41ef-9b11-b6f7fabffe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:19 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Volume f31bf413-3361-4c6c-b98c-6228e37c2be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f31bf413-3361-4c6c-b98c-6228e37c2be7', 'volume_size': 1} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61103750-3727-4077-bc7d-b60c162a1a83,created_at=2026-06-25T16:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-840481035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61103750-3727-4077-bc7d-b60c162a1a83,host='devstack@QuobyteHD#QuobyteHD',id=f31bf413-3361-4c6c-b98c-6228e37c2be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24345a0073eb4f7fafb0a5b055dcd236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:19Z,use_quota=True,user_id='743c39dd692647789d4fec780a479281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da31cd0d-f1f1-4fd6-8403-90000c59834e),volume_type_id=da31cd0d-f1f1-4fd6-8403-90000c59834e)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Creating volume f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:19 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:23:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:19 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 1073741824 Jun 25 18:23:19 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:20 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 1073741824" returned: 0 in 1.023s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:20 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 Jun 25 18:23:20 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:21 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7" returned: 0 in 0.682s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f76e27d-4af6-41ef-9b11-b6f7fabffe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31bf413-3361-4c6c-b98c-6228e37c2be7', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d83073b-ebab-4bb7-be94-e4dfa4da5d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:21 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Volume volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 (f31bf413-3361-4c6c-b98c-6228e37c2be7): created successfully Jun 25 18:23:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d83073b-ebab-4bb7-be94-e4dfa4da5d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Flow 'volume_create_manager' (5848ece6-35f5-470b-abe3-e2462427ffd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:21 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-cb1c1471-e2b7-477a-a66c-28fdcac1d605 tempest-GroupsV314Test-872326020 None] Created volume successfully. Jun 25 18:23:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-daa14544-44b6-42ec-ad2a-29fb0e72de7d req-ac38a7c7-e6b1-44fc-ba18-0c8917698ddd tempest-TestServerVolumeAttachmentScenario-482604943 None] Terminate volume connection completed successfully. Jun 25 18:23:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-daa14544-44b6-42ec-ad2a-29fb0e72de7d req-ac38a7c7-e6b1-44fc-ba18-0c8917698ddd tempest-TestServerVolumeAttachmentScenario-482604943 None] Deleting attachment a623474f-d1cb-4ee1-9074-55ffce4b6586. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:23:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:23 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Cloning volume f31bf413-3361-4c6c-b98c-6228e37c2be7 to volume 96bdb84b-46dc-4e7a-8e87-444e74543dd1 Jun 25 18:23:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Creating offline snapshot 119da30c-3c64-4aaf-9df7-ebba40fef75a of volume f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:23:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9f89a8-b67e-438f-9103-a9c39f7cf311]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:23 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 Jun 25 18:23:23 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:24 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7" returned: 0 in 0.880s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:24 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a 1G Jun 25 18:23:24 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:25 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a 1G" returned: 0 in 0.953s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:25 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a Jun 25 18:23:25 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:26 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a" returned: 0 in 1.217s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:26 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:23:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:26 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a Jun 25 18:23:26 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:27 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a" returned: 0 in 0.701s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:27 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.info Jun 25 18:23:27 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:27 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.info" returned: 0 in 0.938s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:27 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:23:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:28 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.info Jun 25 18:23:28 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:28 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.info" returned: 0 in 1.004s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Acquiring lock "cinder-quobyte-96bdb84b-46dc-4e7a-8e87-444e74543dd1" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Lock "cinder-quobyte-96bdb84b-46dc-4e7a-8e87-444e74543dd1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] snapshot: 119da30c-3c64-4aaf-9df7-ebba40fef75a, volume: 96bdb84b-46dc-4e7a-8e87-444e74543dd1, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[352d37eb-b040-4a46-ab73-8c64ca083541]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:29 devstack sudo[109350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a Jun 25 18:23:29 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:30 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a" returned: 0 in 0.954s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31bf413-3361-4c6c-b98c-6228e37c2be7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:23:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:23:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:23:30 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd7d33-cb5b-4905-8075-191fbb787fc2]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:30 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 Jun 25 18:23:30 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:30 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7" returned: 0 in 0.927s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:30 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:23:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:31 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 Jun 25 18:23:31 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "cinder-3ce0db73-7080-47fd-af3e-e38019d0d19b-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "cinder-3ce0db73-7080-47fd-af3e-e38019d0d19b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "cinder-quobyte-3ce0db73-7080-47fd-af3e-e38019d0d19b" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "cinder-quobyte-3ce0db73-7080-47fd-af3e-e38019d0d19b" acquired by "delete_volume" :: waited 0.041s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:34 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a4eb41-a418-4ea8-9a33-b137aa4e4546]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:34 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b Jun 25 18:23:34 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:36 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b" returned: 0 in 1.795s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:36 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b Jun 25 18:23:36 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=42,cinder:INSERT=12,cinder:UPDATE=42,cinder:DELETE=2 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:23:37 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1" returned: 0 in 6.189s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22dd411-a523-482c-9132-90fb3a95c23e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:37 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-3ce0db73-7080-47fd-af3e-e38019d0d19b" returned: 0 in 1.103s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "cinder-quobyte-3ce0db73-7080-47fd-af3e-e38019d0d19b" released by "delete_volume" :: held 2.999s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Created reservations ['adc4d233-1c21-4417-a12e-8ba4f4708071', 'ce934661-38db-4bea-9b4c-effee9b309d7', '87f9f060-3922-4a0f-b716-cadfe08fd8f5', '4ee817c8-5368-4769-b5ac-2ad35dfd52e1'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:37 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 Jun 25 18:23:37 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:37 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:23:37 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "cinder-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "cinder-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "cinder-quobyte-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "cinder-quobyte-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e" acquired by "delete_volume" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21778e4-9651-4fbf-af38-25d7fbd3201a]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:37 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e Jun 25 18:23:37 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:38 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.797s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:38 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Deleted volume successfully. Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d090b10a-6965-40ae-bdaf-fc6edbdb910e tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "cinder-3ce0db73-7080-47fd-af3e-e38019d0d19b-delete_volume" released by "delete_volume" :: held 4.275s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:38 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7" returned: 0 in 1.221s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:23:38 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Converted 1024.00 MB image at 165.43 MB/s Jun 25 18:23:38 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:38 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 Jun 25 18:23:38 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:38 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e" returned: 0 in 0.985s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:38 devstack sudo[109397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e Jun 25 18:23:38 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Flow 'volume_create_manager' (f32d8e98-e7da-4d2f-9165-a783a94d28a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff01f65-2dcf-40f9-9da6-0ce3b20bb5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff01f65-2dcf-40f9-9da6-0ce3b20bb5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1288408051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05fa30e-c503-46f2-acae-5061b8505afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b117f9b53344b5a9f7f142a8a25dda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:39Z,use_quota=True,user_id='bff94336df594398bf12a437adc4da47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b07670-4385-4778-bb20-329c1e29d874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b07670-4385-4778-bb20-329c1e29d874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8c7ebd-3465-4813-8f7f-f034872f1ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8c7ebd-3465-4813-8f7f-f034872f1ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c05fa30e-c503-46f2-acae-5061b8505afb', 'volume_name': 'volume-c05fa30e-c503-46f2-acae-5061b8505afb', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17d14e5-4e09-4f63-86c9-7eec24d7eddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17d14e5-4e09-4f63-86c9-7eec24d7eddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244d8ac4-c3f0-4664-8e04-fee854c1a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Volume c05fa30e-c503-46f2-acae-5061b8505afb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c05fa30e-c503-46f2-acae-5061b8505afb', 'volume_size': 1} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:39 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1" returned: 0 in 0.739s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Lock "cinder-quobyte-96bdb84b-46dc-4e7a-8e87-444e74543dd1" released by "_copy_volume_from_snapshot" :: held 10.130s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Acquiring lock "cinder-quobyte-119da30c-3c64-4aaf-9df7-ebba40fef75a" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Lock "cinder-quobyte-119da30c-3c64-4aaf-9df7-ebba40fef75a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Deleting offline snapshot 119da30c-3c64-4aaf-9df7-ebba40fef75a of volume f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] snapshot_file for this snap is: volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[517f5ffa-96a0-4261-bd94-c4fee4c29ef5]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:39 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a Jun 25 18:23:39 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:39 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e" returned: 0 in 0.714s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "cinder-quobyte-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e" released by "delete_volume" :: held 1.757s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Created reservations ['68dc7822-46dc-4f96-95ab-928f88966b2f', '30fb14f3-81cb-4cba-866b-1a890b4dbce8', '79b4f569-bc54-4c42-a6bd-6137b12f2935', '8ab4c280-6f1c-4489-ad3d-750478056087'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:39 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:23:39 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:40 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a" returned: 0 in 0.814s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31bf413-3361-4c6c-b98c-6228e37c2be7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ad58c0-43cf-4220-bf56-abca3f5e0cce]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:40 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 Jun 25 18:23:40 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:40 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.685s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:40 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Deleted volume successfully. Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a9035b98-c44e-45b6-83fb-ba4a520773eb tempest-TestServerVolumeAttachmentScenario-482604943 None] Lock "cinder-41ef05c5-25f6-4abf-9f7d-ed40b6a8701e-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:40 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:23:40 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:41 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7" returned: 0 in 0.951s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:41 devstack sudo[109416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a Jun 25 18:23:41 devstack sudo[109416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:41 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.804s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:23:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:23:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:23:41 devstack sudo[109416]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a" returned: 0 in 0.843s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:41 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a Jun 25 18:23:41 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:42 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7.119da30c-3c64-4aaf-9df7-ebba40fef75a" returned: 0 in 0.753s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Lock "cinder-quobyte-119da30c-3c64-4aaf-9df7-ebba40fef75a" released by "_delete_snapshot" :: held 3.482s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.521s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.668s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1288408051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05fa30e-c503-46f2-acae-5061b8505afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b117f9b53344b5a9f7f142a8a25dda9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:39Z,use_quota=True,user_id='bff94336df594398bf12a437adc4da47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Creating volume c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:42 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:23:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:42 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb 1073741824 Jun 25 18:23:42 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:42 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5a57df32-cc9d-438d-8cc8-3cf99fe89741 tempest-GroupsV314Test-872326020 None] Create group from source-group-61103750-3727-4077-bc7d-b60c162a1a83 completed successfully. Jun 25 18:23:43 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Acquiring lock "cinder-quobyte-96bdb84b-46dc-4e7a-8e87-444e74543dd1" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Lock "cinder-quobyte-96bdb84b-46dc-4e7a-8e87-444e74543dd1" acquired by "delete_volume" :: waited 0.032s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:44 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b236702-9c49-4f52-b8ac-210f0918fb6f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:44 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb 1073741824" returned: 0 in 1.429s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:44 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 Jun 25 18:23:44 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:44 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb Jun 25 18:23:44 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:45 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1" returned: 0 in 1.001s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:45 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1 Jun 25 18:23:45 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:45 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb" returned: 0 in 0.938s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] <== create_volume: return (2446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.450s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244d8ac4-c3f0-4664-8e04-fee854c1a342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05fa30e-c503-46f2-acae-5061b8505afb', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de228b7c-a537-41ad-8223-87dc550ba5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:45 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Volume volume-c05fa30e-c503-46f2-acae-5061b8505afb (c05fa30e-c503-46f2-acae-5061b8505afb): created successfully Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de228b7c-a537-41ad-8223-87dc550ba5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Flow 'volume_create_manager' (f32d8e98-e7da-4d2f-9165-a783a94d28a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-313a726a-0efc-438f-93bd-1634a0e77fd5 tempest-VolumesActionsTest-1642425209 None] Created volume successfully. Jun 25 18:23:45 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-96bdb84b-46dc-4e7a-8e87-444e74543dd1" returned: 0 in 0.913s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Lock "cinder-quobyte-96bdb84b-46dc-4e7a-8e87-444e74543dd1" released by "delete_volume" :: held 1.972s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:46 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Created reservations ['62360280-0933-4fdb-ad98-45ba419d4ccd'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:46 devstack cinder-volume[93767]: WARNING cinder.quota [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-885153289 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-885153289, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:23:46 devstack cinder-volume[93767]: WARNING cinder.quota [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-885153289 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-885153289, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:23:46 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Created reservations ['09816335-4866-4a70-a8f6-d1a0f1586ea0', '688e9235-ad1d-41be-9bd0-2c92171b2bdb', 'b8d18b62-a237-47d9-90ab-5079934f8a40', '54243e12-65ea-4841-bd52-9e8eb044d10a'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:47 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:23:47 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:48 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.683s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:48 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:48 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-3103a1c2-3f3a-4ec2-a90b-f1b1ebd75b06 tempest-GroupsV314Test-872326020 None] Delete group completed successfully. Jun 25 18:23:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Acquiring lock "cinder-quobyte-f31bf413-3361-4c6c-b98c-6228e37c2be7" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Lock "cinder-quobyte-f31bf413-3361-4c6c-b98c-6228e37c2be7" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:50 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cd7f1c-18e9-4280-ba9f-5a70a28eba95]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:51 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 Jun 25 18:23:51 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:51 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7" returned: 0 in 1.040s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:51 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7 Jun 25 18:23:51 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:52 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f31bf413-3361-4c6c-b98c-6228e37c2be7" returned: 0 in 0.853s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Lock "cinder-quobyte-f31bf413-3361-4c6c-b98c-6228e37c2be7" released by "delete_volume" :: held 2.009s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:52 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Created reservations ['c9fdc578-b99f-456b-9d5a-01c4d1f344cb'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:52 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Created reservations ['25551666-ce06-46a5-8b2e-3006d001dbd4', '30cfbbf0-fa34-4394-a4aa-0dffc252c4d0', 'cd594f1c-ba7b-4730-aefb-6106cd77399b', 'd9509bb2-aec2-4773-bf0e-b781d45bf346'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:53 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:23:53 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:53 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.838s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:53 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:53 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b7631fed-8dcf-42eb-a9da-c9fd78fd6696 tempest-GroupsV314Test-872326020 None] Delete group completed successfully. Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (ad4cc263-ab71-4457-bc8e-dc715c5319d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a948e7a-6d4f-42b1-b863-ebdafcc7626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a948e7a-6d4f-42b1-b863-ebdafcc7626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-869488893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dd1288-4498-4044-a1d2-80aa05d8eee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:58Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92dafab-70e4-4e16-9b85-e673040416f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92dafab-70e4-4e16-9b85-e673040416f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927954fa-1eb8-4f1c-b442-5ae497143e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927954fa-1eb8-4f1c-b442-5ae497143e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41dd1288-4498-4044-a1d2-80aa05d8eee9', 'volume_name': 'volume-41dd1288-4498-4044-a1d2-80aa05d8eee9', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff14ba19-ce18-40f0-8610-25c058cc4d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff14ba19-ce18-40f0-8610-25c058cc4d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729b80c7-2bbf-4d15-a55a-3bf94af60630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:57 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Volume 41dd1288-4498-4044-a1d2-80aa05d8eee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41dd1288-4498-4044-a1d2-80aa05d8eee9', 'volume_size': 1} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-869488893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dd1288-4498-4044-a1d2-80aa05d8eee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:58Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Creating volume 41dd1288-4498-4044-a1d2-80aa05d8eee9 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:57 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:23:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:58 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 1073741824 Jun 25 18:23:58 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (c210c217-3c4e-48d6-8994-9adc4f689b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e645e6-e40f-4e3d-9472-794983738b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e645e6-e40f-4e3d-9472-794983738b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507613904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40df5242-fb04-463b-9350-ac198cf0faa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:58Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31e15ac-38a9-4443-b5f3-a5cc51bbd67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31e15ac-38a9-4443-b5f3-a5cc51bbd67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d932b375-0c42-4440-bb0f-9211a0b2fe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d932b375-0c42-4440-bb0f-9211a0b2fe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40df5242-fb04-463b-9350-ac198cf0faa1', 'volume_name': 'volume-40df5242-fb04-463b-9350-ac198cf0faa1', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc68948-bd55-4455-a388-67263fe72ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc68948-bd55-4455-a388-67263fe72ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe2b7ef-0442-48fd-85fe-c4572d5767e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:58 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Volume 40df5242-fb04-463b-9350-ac198cf0faa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40df5242-fb04-463b-9350-ac198cf0faa1', 'volume_size': 1} Jun 25 18:23:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (f52c44ca-a508-4ea1-896c-aa79c98333d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22d6d0b-b012-4e3f-8b2e-30e3a6402b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22d6d0b-b012-4e3f-8b2e-30e3a6402b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1199761648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab290df-89a2-4bb5-b072-2d07edb85ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:59Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b5a339-46ec-4ecb-9f54-dcf96b9721c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b5a339-46ec-4ecb-9f54-dcf96b9721c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1d22cb-5f3f-4026-866e-fa5cba517632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1d22cb-5f3f-4026-866e-fa5cba517632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab290df-89a2-4bb5-b072-2d07edb85ee5', 'volume_name': 'volume-aab290df-89a2-4bb5-b072-2d07edb85ee5', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffcb3f2-ddf8-4fe8-82a4-666edd07ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffcb3f2-ddf8-4fe8-82a4-666edd07ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff38858-fe4c-477e-9bc6-f8fa53419540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Volume aab290df-89a2-4bb5-b072-2d07edb85ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab290df-89a2-4bb5-b072-2d07edb85ee5', 'volume_size': 1} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (1bcb031a-6828-4e07-8b8d-d2d08224b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:59 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4883aaa8-c9e0-4465-a21a-24505d5ad025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 1073741824" returned: 0 in 1.856s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4883aaa8-c9e0-4465-a21a-24505d5ad025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-70029465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:00Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022a0635-2c05-4b1b-af1e-0392d956cdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022a0635-2c05-4b1b-af1e-0392d956cdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcd381d-e41d-47da-94d2-fa425139e4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcd381d-e41d-47da-94d2-fa425139e4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c', 'volume_name': 'volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70fa703-cd46-4e1a-a55c-a58a8e34d544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70fa703-cd46-4e1a-a55c-a58a8e34d544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9f38ce-9f92-46a6-be15-a1d228f0cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:59 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Volume d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c', 'volume_size': 1} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:59 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 Jun 25 18:23:59 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (b0a9bc83-7c26-40f8-9e5b-e0aa47096be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c41d19-c7c6-4b0e-89c8-70c0b1fe4a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c41d19-c7c6-4b0e-89c8-70c0b1fe4a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384989537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6869479-43c6-468e-b2e8-794a0ac9c804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:00Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cea6c5-90ea-480c-a592-7db8facc2597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cea6c5-90ea-480c-a592-7db8facc2597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a9d0f7-87cf-41ae-aeee-67217073e7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a9d0f7-87cf-41ae-aeee-67217073e7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6869479-43c6-468e-b2e8-794a0ac9c804', 'volume_name': 'volume-b6869479-43c6-468e-b2e8-794a0ac9c804', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c05426e-1ea6-444b-93cc-b133892f981d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c05426e-1ea6-444b-93cc-b133892f981d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a4d391-d750-42e3-8371-16bd354f1065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:00 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Volume b6869479-43c6-468e-b2e8-794a0ac9c804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6869479-43c6-468e-b2e8-794a0ac9c804', 'volume_size': 1} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:00 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9" returned: 0 in 0.718s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] <== create_volume: return (2734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.740s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.091s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507613904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40df5242-fb04-463b-9350-ac198cf0faa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:58Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Creating volume 40df5242-fb04-463b-9350-ac198cf0faa1 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:00 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:00 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1 1073741824 Jun 25 18:24:00 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729b80c7-2bbf-4d15-a55a-3bf94af60630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41dd1288-4498-4044-a1d2-80aa05d8eee9', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aa5825-f7f3-43ec-99ac-3f22929b0b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:00 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Volume volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 (41dd1288-4498-4044-a1d2-80aa05d8eee9): created successfully Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aa5825-f7f3-43ec-99ac-3f22929b0b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (ad4cc263-ab71-4457-bc8e-dc715c5319d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:00 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-be736701-e940-42cf-bccb-f46f7e9d8155 tempest-CreateVolumesFromImageTest-2128603053 None] Created volume successfully. Jun 25 18:24:01 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1 1073741824" returned: 0 in 0.931s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:01 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=87,cinder:INSERT=16,cinder:UPDATE=87,cinder:DELETE=4 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:24:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:01 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1 Jun 25 18:24:01 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:02 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1" returned: 0 in 0.776s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.175s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1199761648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab290df-89a2-4bb5-b072-2d07edb85ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:59Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Creating volume aab290df-89a2-4bb5-b072-2d07edb85ee5 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:02 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe2b7ef-0442-48fd-85fe-c4572d5767e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40df5242-fb04-463b-9350-ac198cf0faa1', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:02 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 1073741824 Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6ee6e6-9ede-4b05-b06e-e82331c30230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:02 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:02 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Volume volume-40df5242-fb04-463b-9350-ac198cf0faa1 (40df5242-fb04-463b-9350-ac198cf0faa1): created successfully Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6ee6e6-9ede-4b05-b06e-e82331c30230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (c210c217-3c4e-48d6-8994-9adc4f689b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-536f8a17-f776-43d2-9e99-8c28a22f21c4 tempest-CreateVolumesFromImageTest-2128603053 None] Created volume successfully. Jun 25 18:24:03 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 1073741824" returned: 0 in 1.010s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:03 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 Jun 25 18:24:03 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:04 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5" returned: 0 in 0.712s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.316s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-70029465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:00Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Creating volume d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:04 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff38858-fe4c-477e-9bc6-f8fa53419540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab290df-89a2-4bb5-b072-2d07edb85ee5', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:04 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c 1073741824 Jun 25 18:24:04 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cee5d4-7d8e-4c57-8e52-219fb03ca4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:04 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Volume volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 (aab290df-89a2-4bb5-b072-2d07edb85ee5): created successfully Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cee5d4-7d8e-4c57-8e52-219fb03ca4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (f52c44ca-a508-4ea1-896c-aa79c98333d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-13ec7e6c-2b25-4fa7-921f-9b6597757039 tempest-CreateVolumesFromImageTest-2128603053 None] Created volume successfully. Jun 25 18:24:05 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c 1073741824" returned: 0 in 1.023s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:05 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c Jun 25 18:24:05 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:06 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c" returned: 0 in 1.017s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.980s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384989537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6869479-43c6-468e-b2e8-794a0ac9c804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ba20b53d384953b6aa385336601a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:00Z,use_quota=True,user_id='3eadcddb3574403180913649433c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Creating volume b6869479-43c6-468e-b2e8-794a0ac9c804 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:06 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:06 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804 1073741824 Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9f38ce-9f92-46a6-be15-a1d228f0cf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:06 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b70296b-ff9c-4ce9-844e-e3dedbca7afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:06 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Volume volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c (d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c): created successfully Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b70296b-ff9c-4ce9-844e-e3dedbca7afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:06 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (1bcb031a-6828-4e07-8b8d-d2d08224b680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:06 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-7b9b85bf-ca6c-4938-a8c5-2de4768fa611 tempest-CreateVolumesFromImageTest-2128603053 None] Created volume successfully. Jun 25 18:24:07 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804 1073741824" returned: 0 in 1.191s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:07 devstack sudo[109649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804 Jun 25 18:24:07 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:08 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804" returned: 0 in 1.062s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] <== create_volume: return (2316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a4d391-d750-42e3-8371-16bd354f1065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6869479-43c6-468e-b2e8-794a0ac9c804', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c685a1-52c7-48aa-973d-14cd3e6b6d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:08 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Volume volume-b6869479-43c6-468e-b2e8-794a0ac9c804 (b6869479-43c6-468e-b2e8-794a0ac9c804): created successfully Jun 25 18:24:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c685a1-52c7-48aa-973d-14cd3e6b6d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Flow 'volume_create_manager' (b0a9bc83-7c26-40f8-9e5b-e0aa47096be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:08 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a33a1470-15d6-48d6-808a-3fc8ce16e372 tempest-CreateVolumesFromImageTest-2128603053 None] Created volume successfully. Jun 25 18:24:09 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-b6869479-43c6-468e-b2e8-794a0ac9c804-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:09 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-b6869479-43c6-468e-b2e8-794a0ac9c804-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:09 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-quobyte-b6869479-43c6-468e-b2e8-794a0ac9c804" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:09 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-b6869479-43c6-468e-b2e8-794a0ac9c804" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:09 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a760c03e-772d-4033-8d06-af5421822f26]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:09 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804 Jun 25 18:24:09 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01277651-b4b2-47e4-bd04-d16d40b3ad5e tempest-VolumesActionsTest-1642425209 None] Acquiring lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb" by "attach_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01277651-b4b2-47e4-bd04-d16d40b3ad5e tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb" acquired by "attach_volume" :: waited 0.060s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-01277651-b4b2-47e4-bd04-d16d40b3ad5e tempest-VolumesActionsTest-1642425209 None] Attaching volume c05fa30e-c503-46f2-acae-5061b8505afb to instance fbc4516e-10b5-4ff5-923f-6b176dca9019 at mountpoint /dev/vdb on host None. Jun 25 18:24:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-01277651-b4b2-47e4-bd04-d16d40b3ad5e tempest-VolumesActionsTest-1642425209 None] Attach volume completed successfully. Jun 25 18:24:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-01277651-b4b2-47e4-bd04-d16d40b3ad5e tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb" released by "attach_volume" :: held 0.192s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:10 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804" returned: 0 in 1.151s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:10 devstack sudo[109658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804 Jun 25 18:24:10 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2df2ba47-e4b4-43eb-ace4-47cd6d3950e3 tempest-VolumesActionsTest-1642425209 None] Acquiring lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb-detach_volume" by "detach_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2df2ba47-e4b4-43eb-ace4-47cd6d3950e3 tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2df2ba47-e4b4-43eb-ace4-47cd6d3950e3 tempest-VolumesActionsTest-1642425209 None] Detaching volume c05fa30e-c503-46f2-acae-5061b8505afb from instance fbc4516e-10b5-4ff5-923f-6b176dca9019. Jun 25 18:24:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2df2ba47-e4b4-43eb-ace4-47cd6d3950e3 tempest-VolumesActionsTest-1642425209 None] Detach volume completed successfully. Jun 25 18:24:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2df2ba47-e4b4-43eb-ace4-47cd6d3950e3 tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb-detach_volume" released by "detach_volume" :: held 0.133s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:11 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b6869479-43c6-468e-b2e8-794a0ac9c804" returned: 0 in 0.975s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-b6869479-43c6-468e-b2e8-794a0ac9c804" released by "delete_volume" :: held 2.237s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:11 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Created reservations ['b5e44e31-7735-4e9e-b37f-d48a46d824ad', '681e0313-dbe0-4d5f-b4c2-3cb62a813b17', '731edeb9-7e6b-49fd-817f-d34e7620dd56', '2e1d0388-2623-4121-8d21-0e13c7d3c3bf'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:11 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:11 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:12 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.800s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:12 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:12 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Deleted volume successfully. Jun 25 18:24:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-00e1467a-eb12-4937-a4fd-1946dd97bbbb tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-b6869479-43c6-468e-b2e8-794a0ac9c804-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-quobyte-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:13 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[757a4a4d-364a-41ba-8ade-bc0682604085]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:13 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c Jun 25 18:24:13 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:14 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c" returned: 0 in 0.983s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:14 devstack sudo[109718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c Jun 25 18:24:14 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:14 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c" returned: 0 in 0.725s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c" released by "delete_volume" :: held 1.814s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Created reservations ['486f8f01-a1b2-437b-9528-41983c3d5298', '940e0fe2-d2a0-4b5f-ae24-5be13a99ee32', '3f77e600-700a-4ed9-946d-3d3c3beaac7b', 'c302a602-3c78-450f-993f-1fe520b5bff7'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:15 devstack sudo[109723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:15 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-aab290df-89a2-4bb5-b072-2d07edb85ee5-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-aab290df-89a2-4bb5-b072-2d07edb85ee5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-quobyte-aab290df-89a2-4bb5-b072-2d07edb85ee5" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-aab290df-89a2-4bb5-b072-2d07edb85ee5" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d1863b-5cff-4428-afb4-a162e6077d46]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:15 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 Jun 25 18:24:15 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Flow 'volume_create_manager' (f4f7e64f-59bd-44ae-8086-05c504dc3d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f48a9c-24c2-47c5-b2c4-4fca0e10a781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f48a9c-24c2-47c5-b2c4-4fca0e10a781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1599380489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6f5348-13d6-4a07-be98-d69e39c7372e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f07be2f85d64dcf9d9679e96a65679d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:16Z,use_quota=True,user_id='996b91f44232413f993d51a49416b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed161ea2-2977-437c-95d6-6d596cabf401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed161ea2-2977-437c-95d6-6d596cabf401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69d6d00-c473-45bf-9763-b87be4ee4745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69d6d00-c473-45bf-9763-b87be4ee4745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d6f5348-13d6-4a07-be98-d69e39c7372e', 'volume_name': 'volume-5d6f5348-13d6-4a07-be98-d69e39c7372e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60fab01-5b93-4b93-9a94-fb6027e276a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60fab01-5b93-4b93-9a94-fb6027e276a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d61b43-6795-45d2-829f-64ed8b950297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Volume 5d6f5348-13d6-4a07-be98-d69e39c7372e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d6f5348-13d6-4a07-be98-d69e39c7372e', 'volume_size': 1} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1599380489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6f5348-13d6-4a07-be98-d69e39c7372e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f07be2f85d64dcf9d9679e96a65679d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:16Z,use_quota=True,user_id='996b91f44232413f993d51a49416b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Creating volume 5d6f5348-13d6-4a07-be98-d69e39c7372e {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:15 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:15 devstack sudo[109727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e 1073741824 Jun 25 18:24:15 devstack sudo[109727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:16 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.983s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:16 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:16 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Deleted volume successfully. Jun 25 18:24:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d39db15d-e1f5-45f2-8b05-48c4d8d38484 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-d1b6d1d0-0573-4ac3-8a43-4bcdc4f5803c-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:16 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5" returned: 0 in 0.920s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:16 devstack sudo[109733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5 Jun 25 18:24:16 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:16 devstack sudo[109727]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e 1073741824" returned: 0 in 0.958s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:16 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e Jun 25 18:24:16 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:17 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-aab290df-89a2-4bb5-b072-2d07edb85ee5" returned: 0 in 0.716s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-aab290df-89a2-4bb5-b072-2d07edb85ee5" released by "delete_volume" :: held 1.692s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Created reservations ['9bc2c340-267b-4f89-915d-aa3b5877d7f9', '8b4dbe1f-bdf6-4ff1-b3cc-3816d7cdc6fd', '18c3cc05-1ca7-4520-bf43-f0a21c01c3b3', 'a74c6e65-f117-4476-86ef-c7ed93f5d178'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:17 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:17 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-40df5242-fb04-463b-9350-ac198cf0faa1-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:17 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e" returned: 0 in 0.731s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-40df5242-fb04-463b-9350-ac198cf0faa1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d61b43-6795-45d2-829f-64ed8b950297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d6f5348-13d6-4a07-be98-d69e39c7372e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43110bde-ef2f-4c29-b274-9bee3b2d3933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:17 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Volume volume-5d6f5348-13d6-4a07-be98-d69e39c7372e (5d6f5348-13d6-4a07-be98-d69e39c7372e): created successfully Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43110bde-ef2f-4c29-b274-9bee3b2d3933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Flow 'volume_create_manager' (f4f7e64f-59bd-44ae-8086-05c504dc3d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-quobyte-40df5242-fb04-463b-9350-ac198cf0faa1" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-cba50853-b8be-4c74-838b-98db70b9f6c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Created volume successfully. Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-40df5242-fb04-463b-9350-ac198cf0faa1" acquired by "delete_volume" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f520f-a868-46df-9c7b-7f703506e072]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:17 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1 Jun 25 18:24:17 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:18 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.690s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Deleted volume successfully. Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a2ebca3f-07d2-45bf-b8dd-23bd3d3a9a46 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-aab290df-89a2-4bb5-b072-2d07edb85ee5-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Creating offline snapshot 17258fd3-f738-4ca3-b592-dc3c4eda8342 of volume 5d6f5348-13d6-4a07-be98-d69e39c7372e {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f715f-5209-4ea6-acdf-b5588a89b9ac]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:18 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e Jun 25 18:24:18 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:18 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1" returned: 0 in 0.837s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:18 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1 Jun 25 18:24:18 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:19 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e" returned: 0 in 0.841s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:19 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 1G Jun 25 18:24:19 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:19 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40df5242-fb04-463b-9350-ac198cf0faa1" returned: 0 in 0.748s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-40df5242-fb04-463b-9350-ac198cf0faa1" released by "delete_volume" :: held 1.663s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Created reservations ['04810fe9-fbf2-4582-b151-bbebdbaf4cc9', 'bab3168a-fae8-43c7-84db-2ee0bd0bf743', '1a618b7b-7c57-4753-b807-f20ac6f7d1e4', '4e05f306-780b-4928-bfcc-e0374916f4ea'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:19 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:19 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-41dd1288-4498-4044-a1d2-80aa05d8eee9-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-41dd1288-4498-4044-a1d2-80aa05d8eee9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:20 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 1G" returned: 0 in 1.004s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d6f5348-13d6-4a07-be98-d69e39c7372e -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "cinder-quobyte-41dd1288-4498-4044-a1d2-80aa05d8eee9" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:20 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d6f5348-13d6-4a07-be98-d69e39c7372e -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 Jun 25 18:24:20 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-41dd1288-4498-4044-a1d2-80aa05d8eee9" acquired by "delete_volume" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[26575ca3-a970-425b-bf52-bb1b7b05ab9f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:20 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 Jun 25 18:24:20 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:20 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.877s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:20 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Deleted volume successfully. Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c84abb11-b994-4f93-929c-acbcbe777674 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-40df5242-fb04-463b-9350-ac198cf0faa1-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:20 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d6f5348-13d6-4a07-be98-d69e39c7372e -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342" returned: 0 in 0.839s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:20 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 is being set with open permissions: ugo+rw Jun 25 18:24:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:20 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 Jun 25 18:24:20 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:21 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9" returned: 0 in 0.892s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:21 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9 Jun 25 18:24:21 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:21 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342" returned: 0 in 0.796s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:21 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.info Jun 25 18:24:21 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:21 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41dd1288-4498-4044-a1d2-80aa05d8eee9" returned: 0 in 0.814s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-quobyte-41dd1288-4498-4044-a1d2-80aa05d8eee9" released by "delete_volume" :: held 1.759s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:21 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Created reservations ['99ea407d-d695-4b8d-8da6-c4045a25f4de', '8e28567b-eb79-48fe-a65b-ba4562e1d9f6', '966a830b-9e5d-447b-a5b5-1408cf3155a0', '992ee37a-4df3-4160-a9ae-4149a2ca374c'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:22 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:22 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:22 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.info" returned: 0 in 0.872s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:22 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.info is being set with open permissions: ugo+rw Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:22 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.info Jun 25 18:24:22 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:22 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.855s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Deleted volume successfully. Jun 25 18:24:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2825a515-edc2-48f9-a045-cf85baf49f06 tempest-CreateVolumesFromImageTest-2128603053 None] Lock "cinder-41dd1288-4498-4044-a1d2-80aa05d8eee9-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:23 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.info" returned: 0 in 0.922s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.393s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-be9d996e-ed2b-45b6-8fff-f6ea17c07ae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Create snapshot completed successfully Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Acquiring lock "cinder-17258fd3-f738-4ca3-b592-dc3c4eda8342-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-17258fd3-f738-4ca3-b592-dc3c4eda8342-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Acquiring lock "cinder-quobyte-5d6f5348-13d6-4a07-be98-d69e39c7372e" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-quobyte-5d6f5348-13d6-4a07-be98-d69e39c7372e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Acquiring lock "cinder-quobyte-17258fd3-f738-4ca3-b592-dc3c4eda8342" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-quobyte-17258fd3-f738-4ca3-b592-dc3c4eda8342" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Deleting offline snapshot 17258fd3-f738-4ca3-b592-dc3c4eda8342 of volume 5d6f5348-13d6-4a07-be98-d69e39c7372e {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] snapshot_file for this snap is: volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[9371c2e1-5319-448b-b250-fd00974aec74]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:25 devstack sudo[109798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 Jun 25 18:24:25 devstack sudo[109798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (077c1d4b-1c83-41ad-b129-dbf5fbb33d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:25 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d4ae35-1080-410b-89b9-0315b0097f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d4ae35-1080-410b-89b9-0315b0097f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032687261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a659680e-dd1d-4bc4-9ad5-c191fefcc56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:26Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2160fd25-2b9d-4cde-ab92-21a5ac8d80f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2160fd25-2b9d-4cde-ab92-21a5ac8d80f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ade5d53-9f27-40c6-ac19-4b20ce916bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ade5d53-9f27-40c6-ac19-4b20ce916bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a659680e-dd1d-4bc4-9ad5-c191fefcc56d', 'volume_name': 'volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8315d691-3f73-4b85-9611-112a0f258acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8315d691-3f73-4b85-9611-112a0f258acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df10da9-ae11-476c-a1bf-d1d3ba50238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:26 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume a659680e-dd1d-4bc4-9ad5-c191fefcc56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d', 'volume_size': 1} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032687261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a659680e-dd1d-4bc4-9ad5-c191fefcc56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:26Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Creating volume a659680e-dd1d-4bc4-9ad5-c191fefcc56d {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:26 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:26 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d 1073741824 Jun 25 18:24:26 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:26 devstack sudo[109798]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342" returned: 0 in 1.099s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d6f5348-13d6-4a07-be98-d69e39c7372e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5729a1-41a6-4758-85fe-2d5fcbd441b5]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:26 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e Jun 25 18:24:26 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:27 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d 1073741824" returned: 0 in 1.199s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:27 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d Jun 25 18:24:27 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:27 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e" returned: 0 in 1.151s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:27 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 Jun 25 18:24:27 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:28 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" returned: 0 in 0.982s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df10da9-ae11-476c-a1bf-d1d3ba50238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a477e79-6756-4bc0-8a20-a56de9737b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:28 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d (a659680e-dd1d-4bc4-9ad5-c191fefcc56d): created successfully Jun 25 18:24:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a477e79-6756-4bc0-8a20-a56de9737b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:28 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (077c1d4b-1c83-41ad-b129-dbf5fbb33d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:28 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0288ea48-46a0-4191-ba70-136c3fc98965 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created volume successfully. Jun 25 18:24:28 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342" returned: 0 in 0.996s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:28 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342 Jun 25 18:24:28 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:29 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e.17258fd3-f738-4ca3-b592-dc3c4eda8342" returned: 0 in 0.720s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-quobyte-17258fd3-f738-4ca3-b592-dc3c4eda8342" released by "_delete_snapshot" :: held 4.098s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-quobyte-5d6f5348-13d6-4a07-be98-d69e39c7372e" released by "delete_snapshot" :: held 4.123s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Created reservations ['73c0be2a-e105-4ceb-9f41-dbd02c35b3be', '4e859b29-e2e6-456e-b295-840c15d75f1b', '0c605ec8-45f0-4835-b44a-bda0acab5936', 'ecf5a863-f5bb-44f1-b46f-c2c862e2a531'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Delete snapshot completed successfully. Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-09418252-eb29-4320-bec7-16a7b22ca338 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-17258fd3-f738-4ca3-b592-dc3c4eda8342-delete_snapshot" released by "delete_snapshot" :: held 4.341s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Creating offline snapshot c73c2db3-0349-46ff-8d91-a9a3f837b65a of volume a659680e-dd1d-4bc4-9ad5-c191fefcc56d {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a06bddc-01bd-4953-a46e-6f6081e4d6fb]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:29 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d Jun 25 18:24:29 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:30 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" returned: 0 in 0.859s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:30 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a 1G Jun 25 18:24:30 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Acquiring lock "cinder-5d6f5348-13d6-4a07-be98-d69e39c7372e-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-5d6f5348-13d6-4a07-be98-d69e39c7372e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Acquiring lock "cinder-quobyte-5d6f5348-13d6-4a07-be98-d69e39c7372e" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-quobyte-5d6f5348-13d6-4a07-be98-d69e39c7372e" acquired by "delete_volume" :: waited 0.015s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:30 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a1a753-b04a-441c-a073-c40dfda77f35]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:30 devstack sudo[109852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e Jun 25 18:24:30 devstack sudo[109852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:31 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a 1G" returned: 0 in 0.938s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:31 devstack sudo[109858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a Jun 25 18:24:31 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:31 devstack sudo[109852]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e" returned: 0 in 0.880s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:31 devstack sudo[109867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e Jun 25 18:24:31 devstack sudo[109867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:32 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a" returned: 0 in 0.884s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:32 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a is being set with open permissions: ugo+rw Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:32 devstack sudo[109867]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-5d6f5348-13d6-4a07-be98-d69e39c7372e" returned: 0 in 0.682s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:32 devstack sudo[109873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a Jun 25 18:24:32 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-quobyte-5d6f5348-13d6-4a07-be98-d69e39c7372e" released by "delete_volume" :: held 1.649s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Created reservations ['d5df8b50-794f-4ed7-abc6-db1f0ec03be8', 'd36d71a9-2428-4760-b1cc-b56914549c1b', 'ad961e8f-e22a-44d4-bf40-a2e0676c65ff', '88b2a286-62d9-4719-8ca9-6df335c3af9d'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:32 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:32 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:32 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a" returned: 0 in 0.699s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:32 devstack sudo[109879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.info Jun 25 18:24:32 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:33 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.740s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:33 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:33 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Deleted volume successfully. Jun 25 18:24:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f5b3007b-9d52-4278-a809-06a39d46acc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1063261006 None] Lock "cinder-5d6f5348-13d6-4a07-be98-d69e39c7372e-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:33 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.info" returned: 0 in 0.769s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:33 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.info is being set with open permissions: ugo+rw Jun 25 18:24:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:33 devstack sudo[109897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.info Jun 25 18:24:33 devstack sudo[109897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:34 devstack sudo[109897]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.info" returned: 0 in 1.053s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.371s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:34 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-acdecbdb-e062-4f17-bede-0bc104d59076 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Create snapshot completed successfully Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (4cd0b7b9-146c-4588-8016-b9dbd7f3144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff1530b-5fe4-4d9c-beed-ca650e34cb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff1530b-5fe4-4d9c-beed-ca650e34cb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434887468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b52050-b3b8-4f0a-bbfb-5cfb692de79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:36Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62232da8-7abe-44f4-b731-03deb6316bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62232da8-7abe-44f4-b731-03deb6316bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd0212c-7b6f-4b85-a999-8c1c51fd8c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd0212c-7b6f-4b85-a999-8c1c51fd8c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b52050-b3b8-4f0a-bbfb-5cfb692de79c', 'volume_name': 'volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aa3491-c7ae-4267-a82e-e9f5b909d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aa3491-c7ae-4267-a82e-e9f5b909d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b03ef57-f485-4baf-a89d-980df32634ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:36 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume 93b52050-b3b8-4f0a-bbfb-5cfb692de79c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c', 'volume_size': 1} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434887468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b52050-b3b8-4f0a-bbfb-5cfb692de79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:36Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Creating volume 93b52050-b3b8-4f0a-bbfb-5cfb692de79c {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:36 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:36 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c 1073741824 Jun 25 18:24:36 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=90,cinder:INSERT=34,cinder:UPDATE=124,cinder:DELETE=8 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (85d6e5eb-441a-4e67-8e82-398dea0d187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d6610d-dd91-4a53-99fa-3f4ab454cbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d6610d-dd91-4a53-99fa-3f4ab454cbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288667842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b79f865-a37e-4fa6-89c0-2aa03b5558b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:37Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c5f1cd-8b51-46b9-b139-437195981293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c5f1cd-8b51-46b9-b139-437195981293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24d1362-2a9c-429e-bf73-b5d5a480c30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24d1362-2a9c-429e-bf73-b5d5a480c30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b79f865-a37e-4fa6-89c0-2aa03b5558b5', 'volume_name': 'volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9e64fa-89d8-43af-89e2-fe16c908f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9e64fa-89d8-43af-89e2-fe16c908f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bacb602-f3da-4259-aadf-3c710af8e666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:37 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume 2b79f865-a37e-4fa6-89c0-2aa03b5558b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5', 'volume_size': 1} Jun 25 18:24:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (d54d183c-afea-45a7-83a9-f02d3a546b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bd3d59-a314-4911-9dbb-dc6813fe0b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bd3d59-a314-4911-9dbb-dc6813fe0b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2008614104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc5e0ec-e617-45ed-8aca-065cdbcc1c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:38Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efffe51-3ba1-4a5a-85e3-47f977700bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efffe51-3ba1-4a5a-85e3-47f977700bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291fa8bb-4d63-4163-b215-60a210cf5c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291fa8bb-4d63-4163-b215-60a210cf5c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc5e0ec-e617-45ed-8aca-065cdbcc1c29', 'volume_name': 'volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503f170b-7e39-4dc4-b2f7-667b27e43aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503f170b-7e39-4dc4-b2f7-667b27e43aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc0ecaa-b19c-4218-851c-5fa26bdb1cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume 0cc5e0ec-e617-45ed-8aca-065cdbcc1c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29', 'volume_size': 1} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-203965d5-9bab-4b48-8739-9e56517dcb6f tempest-VolumesActionsTest-1642425209 None] Acquiring lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb" by "attach_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-203965d5-9bab-4b48-8739-9e56517dcb6f tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb" acquired by "attach_volume" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:38 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c 1073741824" returned: 0 in 1.614s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:38 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-203965d5-9bab-4b48-8739-9e56517dcb6f tempest-VolumesActionsTest-1642425209 None] Attaching volume c05fa30e-c503-46f2-acae-5061b8505afb to instance 523b1fd4-4c13-4d7f-b77e-1fafad80f0a4 at mountpoint /dev/vdb on host None. Jun 25 18:24:38 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c Jun 25 18:24:38 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:38 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-203965d5-9bab-4b48-8739-9e56517dcb6f tempest-VolumesActionsTest-1642425209 None] Attach volume completed successfully. Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-203965d5-9bab-4b48-8739-9e56517dcb6f tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb" released by "attach_volume" :: held 0.218s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (0a8fbfa3-2e4e-4b0d-b9ae-5f2c9a95b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4188a41f-7320-4c6f-8c11-c42ab2d8ca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4188a41f-7320-4c6f-8c11-c42ab2d8ca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120078044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b008734-0678-48c2-81a8-8f64eaadb907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:39Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f9c9fd-d05d-4698-aa50-f4ac057193d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f9c9fd-d05d-4698-aa50-f4ac057193d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d6aa22-a5ca-4605-a0d1-1ca9d129a257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d6aa22-a5ca-4605-a0d1-1ca9d129a257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b008734-0678-48c2-81a8-8f64eaadb907', 'volume_name': 'volume-9b008734-0678-48c2-81a8-8f64eaadb907', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9347cc7e-353a-4a6b-8db8-6be7d305a1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9347cc7e-353a-4a6b-8db8-6be7d305a1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba576c9-1fcc-4354-88c1-666d55df0b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume 9b008734-0678-48c2-81a8-8f64eaadb907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b008734-0678-48c2-81a8-8f64eaadb907', 'volume_size': 1} Jun 25 18:24:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b38aebda-2217-491c-9a9f-7b510f4a991d tempest-VolumesActionsTest-1642425209 None] Acquiring lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb-detach_volume" by "detach_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b38aebda-2217-491c-9a9f-7b510f4a991d tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b38aebda-2217-491c-9a9f-7b510f4a991d tempest-VolumesActionsTest-1642425209 None] Detaching volume c05fa30e-c503-46f2-acae-5061b8505afb from instance 523b1fd4-4c13-4d7f-b77e-1fafad80f0a4. Jun 25 18:24:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-b38aebda-2217-491c-9a9f-7b510f4a991d tempest-VolumesActionsTest-1642425209 None] Detach volume completed successfully. Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-b38aebda-2217-491c-9a9f-7b510f4a991d tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (887ff835-a5a6-44c4-9f44-03b8403d4a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c157e10-6198-43bb-a8c0-29acc759f2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c157e10-6198-43bb-a8c0-29acc759f2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733587230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f3a3a1-19a9-4a75-9e8f-dd5bd1024623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:39Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:39 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b4c039-92d2-4589-a172-9bd57d020fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b4c039-92d2-4589-a172-9bd57d020fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340064c2-cd78-421f-9e5b-7b6a71e443a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340064c2-cd78-421f-9e5b-7b6a71e443a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f3a3a1-19a9-4a75-9e8f-dd5bd1024623', 'volume_name': 'volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08445e9a-753b-4a77-9d9e-8a882c58f41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08445e9a-753b-4a77-9d9e-8a882c58f41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a12b74d-6fcb-4c64-8a27-f0a962ba33b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume 13f3a3a1-19a9-4a75-9e8f-dd5bd1024623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623', 'volume_size': 1} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c" returned: 0 in 1.187s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] <== create_volume: return (2903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.910s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.989s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288667842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b79f865-a37e-4fa6-89c0-2aa03b5558b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:37Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Creating volume 2b79f865-a37e-4fa6-89c0-2aa03b5558b5 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:39 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b03ef57-f485-4baf-a89d-980df32634ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33cc232-63e2-4a7d-8fe6-8a19e25a3f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:39 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 1073741824 Jun 25 18:24:39 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c (93b52050-b3b8-4f0a-bbfb-5cfb692de79c): created successfully Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33cc232-63e2-4a7d-8fe6-8a19e25a3f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (4cd0b7b9-146c-4588-8016-b9dbd7f3144e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a4441a04-5365-4063-adcd-9fff943bf896 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created volume successfully. Jun 25 18:24:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:24:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:40 devstack sudo[109982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:40 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:40 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 1073741824" returned: 0 in 1.344s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:41 devstack sudo[109984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 Jun 25 18:24:41 devstack sudo[109984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:41 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.031s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:24:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:24:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:24:42 devstack sudo[109984]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5" returned: 0 in 1.095s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] <== create_volume: return (2510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.827s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2008614104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc5e0ec-e617-45ed-8aca-065cdbcc1c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:38Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Creating volume 0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:42 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:42 devstack sudo[110032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 1073741824 Jun 25 18:24:42 devstack sudo[110032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bacb602-f3da-4259-aadf-3c710af8e666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e843d6a-45ec-43fe-b166-48ff54eec03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:42 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 (2b79f865-a37e-4fa6-89c0-2aa03b5558b5): created successfully Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e843d6a-45ec-43fe-b166-48ff54eec03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (85d6e5eb-441a-4e67-8e82-398dea0d187d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:42 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0afb3536-2f92-472b-aaf7-8a3144751bb9 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created volume successfully. Jun 25 18:24:43 devstack sudo[110032]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 1073741824" returned: 0 in 1.015s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:43 devstack sudo[110040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 Jun 25 18:24:43 devstack sudo[110040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:43 devstack sudo[110040]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29" returned: 0 in 0.818s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.094s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120078044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b008734-0678-48c2-81a8-8f64eaadb907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:39Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Creating volume 9b008734-0678-48c2-81a8-8f64eaadb907 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:44 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc0ecaa-b19c-4218-851c-5fa26bdb1cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a0c2a3-9b69-4e55-85a5-eec7d6acc373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:44 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907 1073741824 Jun 25 18:24:44 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:44 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 (0cc5e0ec-e617-45ed-8aca-065cdbcc1c29): created successfully Jun 25 18:24:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a0c2a3-9b69-4e55-85a5-eec7d6acc373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (d54d183c-afea-45a7-83a9-f02d3a546b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-496e737e-a88c-40ab-b0d2-37fe89633231 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created volume successfully. Jun 25 18:24:45 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907 1073741824" returned: 0 in 1.063s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:45 devstack sudo[110051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907 Jun 25 18:24:45 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:45 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907" returned: 0 in 0.707s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.252s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733587230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f3a3a1-19a9-4a75-9e8f-dd5bd1024623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106316e3fc2441868ff26f9c3b603835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:39Z,use_quota=True,user_id='66044fa5c7804596bd331da8f0ee4405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Creating volume 13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:45 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:45 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 1073741824 Jun 25 18:24:45 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba576c9-1fcc-4354-88c1-666d55df0b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b008734-0678-48c2-81a8-8f64eaadb907', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21e816c-8c0e-4001-826a-dd52f7921f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:45 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume volume-9b008734-0678-48c2-81a8-8f64eaadb907 (9b008734-0678-48c2-81a8-8f64eaadb907): created successfully Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21e816c-8c0e-4001-826a-dd52f7921f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:45 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (0a8fbfa3-2e4e-4b0d-b9ae-5f2c9a95b435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-dfb209fc-ccb6-4688-9752-cd57901a176b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created volume successfully. Jun 25 18:24:46 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 1073741824" returned: 0 in 1.137s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:47 devstack sudo[110060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 Jun 25 18:24:47 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Flow 'volume_create_manager' (87ca1ddd-8f7b-4f3f-b30d-1fb9bc95e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fc5604-d1a5-416e-bda2-120946736a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fc5604-d1a5-416e-bda2-120946736a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1573747339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecc70f5-88b8-40ad-9797-e38a8902f3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f850610ea74e2cbef179cae4dc9a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:47Z,use_quota=True,user_id='7d31b0d8aba741ec8565d20899b919c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8375454-42b2-40ba-99b9-561cb2b9cef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8375454-42b2-40ba-99b9-561cb2b9cef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8625a9-20d3-4015-8f21-99e853045a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.image.glance [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Creating Keystone auth plugin from conf {{(pid=93767) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:24:47 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623" returned: 0 in 0.793s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a12b74d-6fcb-4c64-8a27-f0a962ba33b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec8d8f2-1844-46d1-9be8-6f2c916a2f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:47 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Volume volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 (13f3a3a1-19a9-4a75-9e8f-dd5bd1024623): created successfully Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec8d8f2-1844-46d1-9be8-6f2c916a2f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Flow 'volume_create_manager' (887ff835-a5a6-44c4-9f44-03b8403d4a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:47 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e98747c6-fcde-4964-ad1f-769d23966c23 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created volume successfully. Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8625a9-20d3-4015-8f21-99e853045a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ecc70f5-88b8-40ad-9797-e38a8902f3b3', 'volume_name': 'volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efad4902-da4a-4252-a357-839fe5338b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efad4902-da4a-4252-a357-839fe5338b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca506981-b87e-4d90-9bfb-bef3a9dde7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:47 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Volume 2ecc70f5-88b8-40ad-9797-e38a8902f3b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 18:24:47 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Trying to clone 2ecc70f5-88b8-40ad-9797-e38a8902f3b3 from image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]). {{(pid=93767) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:24:48 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Image download 20.69 MB at 20.69 MB/s Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e26b09-f090-4aa6-a2d4-fa0777bb8887]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:48 devstack sudo[110064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD Jun 25 18:24:48 devstack sudo[110064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-quobyte-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50ca7b4-e5b5-47ee-9ceb-979d03452089]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:48 devstack sudo[110066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 Jun 25 18:24:48 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[827505bd-3f56-44b4-9216-7341d10e85ef]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:49 devstack sudo[110068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb Jun 25 18:24:49 devstack sudo[110068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:49 devstack sudo[110064]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD" returned: 0 in 0.862s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:49 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Temporary image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f is fetched for user 7d31b0d8aba741ec8565d20899b919c3. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:24:49 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4519a473-a6d8-43ce-874e-321183df8098]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:49 devstack sudo[110073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD Jun 25 18:24:49 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:49 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623" returned: 0 in 0.904s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:49 devstack sudo[110078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623 Jun 25 18:24:49 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:49 devstack sudo[110068]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb" returned: 0 in 0.843s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:49 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1051704-4078-41bd-83a1-ce279f17bbdc]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:49 devstack sudo[110083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb Jun 25 18:24:49 devstack sudo[110083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:50 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD" returned: 0 in 0.846s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:50 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623" returned: 0 in 0.735s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623" released by "delete_volume" :: held 1.688s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created reservations ['90f06371-3d30-4347-ba65-0d9b1a14e4bd', 'db1c39d0-cafe-4b3e-9841-5b9aca96ac60', 'eb287fab-765d-4619-9ee5-a10ff1b3b366', '7fd66d3a-665f-4dfe-a079-46c7dfa3e01f'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:50 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:50 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:50 devstack sudo[110083]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb" returned: 0 in 0.878s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.8fcc9e5c-dabd-488a-a3b3-cc557df9778a3wkb97c7.img {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:50 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.8fcc9e5c-dabd-488a-a3b3-cc557df9778a3wkb97c7.img Jun 25 18:24:50 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-9b008734-0678-48c2-81a8-8f64eaadb907-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-9b008734-0678-48c2-81a8-8f64eaadb907-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-quobyte-9b008734-0678-48c2-81a8-8f64eaadb907" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-9b008734-0678-48c2-81a8-8f64eaadb907" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b5702b-4885-4e72-be9b-c0bd715ff05e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:50 devstack sudo[110132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907 Jun 25 18:24:50 devstack sudo[110132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:51 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.717s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:51 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Deleted volume successfully. Jun 25 18:24:51 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-da53c358-3e28-495c-a2dc-f10a3fe3f9fe tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-13f3a3a1-19a9-4a75-9e8f-dd5bd1024623-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:52 devstack sudo[110132]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907" returned: 0 in 1.283s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:52 devstack sudo[110149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907 Jun 25 18:24:52 devstack sudo[110149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:53 devstack sudo[110149]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-9b008734-0678-48c2-81a8-8f64eaadb907" returned: 0 in 1.491s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:53 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-9b008734-0678-48c2-81a8-8f64eaadb907" released by "delete_volume" :: held 2.837s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:53 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created reservations ['50e0cb53-185a-4048-9577-8fde63628680', '806e585a-3da6-45af-8fbc-d9630700affa', '81b3b5e2-8a15-461f-9370-80443ba029f2', '006f0ac5-d2da-486d-8f6f-82f1373d22cc'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:54 devstack sudo[110155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:54 devstack sudo[110155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-quobyte-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[404945ed-ba46-49d6-83ac-726ad776b38c]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:54 devstack sudo[110157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 Jun 25 18:24:54 devstack sudo[110157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:55 devstack sudo[110155]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.721s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:55 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:55 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Deleted volume successfully. Jun 25 18:24:55 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3a052b2e-8297-425f-8ac4-a5a21720002f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-9b008734-0678-48c2-81a8-8f64eaadb907-delete_volume" released by "delete_volume" :: held 5.045s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:56 devstack sudo[110157]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29" returned: 0 in 1.542s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:56 devstack sudo[110163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29 Jun 25 18:24:56 devstack sudo[110163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:56 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.8fcc9e5c-dabd-488a-a3b3-cc557df9778a3wkb97c7.img" returned: 0 in 5.556s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:56 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc25545e-1705-4469-b24b-92b9adfb5909]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:56 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb Jun 25 18:24:56 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:56 devstack sudo[110163]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29" returned: 0 in 0.705s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:56 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29" released by "delete_volume" :: held 2.328s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:56 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created reservations ['140704e2-41b7-4962-a339-2312440ba9c2', 'bdc5b4e4-82e3-4112-a63a-cb733e5c28c3', 'e5acfc27-aa44-4ebc-9b43-5dab73453132', 'ac1c622b-e1e1-4900-adeb-f89baa7b37c8'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:57 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:57 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:57 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb" returned: 0 in 1.082s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.8fcc9e5c-dabd-488a-a3b3-cc557df9778a3wkb97c7.img {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:24:57 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Converted 1024.00 MB image at 184.24 MB/s Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] 8fcc9e5c-dabd-488a-a3b3-cc557df9778a was raw, no need to convert to raw {{(pid=93767) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 25 18:24:57 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.725s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:57 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Deleted volume successfully. Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-10e3cee8-b6d4-48b0-91ce-1b3bf7ab07f1 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-0cc5e0ec-e617-45ed-8aca-065cdbcc1c29-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-2b79f865-a37e-4fa6-89c0-2aa03b5558b5-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-2b79f865-a37e-4fa6-89c0-2aa03b5558b5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:57 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-quobyte-2b79f865-a37e-4fa6-89c0-2aa03b5558b5" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-2b79f865-a37e-4fa6-89c0-2aa03b5558b5" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:58 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e57aa2a-fdc7-4662-a1b9-edbc6294aa0a]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:58 devstack sudo[110174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 Jun 25 18:24:58 devstack sudo[110174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:58 devstack sudo[110174]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5" returned: 0 in 0.898s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:58 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5 Jun 25 18:24:58 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:59 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2b79f865-a37e-4fa6-89c0-2aa03b5558b5" returned: 0 in 0.730s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-2b79f865-a37e-4fa6-89c0-2aa03b5558b5" released by "delete_volume" :: held 1.670s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:59 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created reservations ['0f483f7b-8017-43d3-8315-0d162fb51d39', '8153ccbf-e996-44ce-b5ca-8fc001c132fe', '8cf4bf71-1656-4611-a6f0-b791c88ec611', 'af850b8c-aec9-4262-b4eb-0d64422fd581'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:59 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:59 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:59 devstack sudo[110182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:24:59 devstack sudo[110182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-93b52050-b3b8-4f0a-bbfb-5cfb692de79c-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-93b52050-b3b8-4f0a-bbfb-5cfb692de79c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-quobyte-93b52050-b3b8-4f0a-bbfb-5cfb692de79c" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-93b52050-b3b8-4f0a-bbfb-5cfb692de79c" acquired by "delete_volume" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:00 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74d2fa8-bc22-4e8a-be36-c7258188dbcd]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:00 devstack sudo[110184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c Jun 25 18:25:00 devstack sudo[110184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:00 devstack sudo[110182]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.823s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:00 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:00 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Deleted volume successfully. Jun 25 18:25:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e5ec3162-7ac3-43db-af32-13b84900c26f tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-2b79f865-a37e-4fa6-89c0-2aa03b5558b5-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:01 devstack sudo[110184]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c" returned: 0 in 0.955s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:01 devstack sudo[110190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c Jun 25 18:25:01 devstack sudo[110190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:02 devstack sudo[110190]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-93b52050-b3b8-4f0a-bbfb-5cfb692de79c" returned: 0 in 0.725s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-93b52050-b3b8-4f0a-bbfb-5cfb692de79c" released by "delete_volume" :: held 1.735s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=122,cinder:DELETE=14,cinder:SELECT=106,cinder:INSERT=30 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created reservations ['381eabed-7aef-4b99-9441-4b638f02bcbb', '1f1b08c8-490c-48fd-9ad9-143a9247e3e7', '062216d8-3738-4a8e-86b7-7e794323d440', 'e3fbb193-ee47-491e-ac21-7e8bf561c1fb'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:02 devstack sudo[110196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:25:02 devstack sudo[110196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-c73c2db3-0349-46ff-8d91-a9a3f837b65a-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-c73c2db3-0349-46ff-8d91-a9a3f837b65a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-quobyte-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-quobyte-c73c2db3-0349-46ff-8d91-a9a3f837b65a" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-c73c2db3-0349-46ff-8d91-a9a3f837b65a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Deleting offline snapshot c73c2db3-0349-46ff-8d91-a9a3f837b65a of volume a659680e-dd1d-4bc4-9ad5-c191fefcc56d {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] snapshot_file for this snap is: volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eae1fe3-854f-4d29-96c4-b2440b1dea76]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:02 devstack sudo[110198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a Jun 25 18:25:02 devstack sudo[110198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:02 devstack sudo[110196]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.785s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:02 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Deleted volume successfully. Jun 25 18:25:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dad7b671-c758-4e9a-813e-0c16e4788ce2 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-93b52050-b3b8-4f0a-bbfb-5cfb692de79c-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:03 devstack sudo[110198]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a" returned: 0 in 0.869s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:03 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[837639c7-d3e7-4561-ac16-6fe0532a75cb]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:03 devstack sudo[110206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d Jun 25 18:25:03 devstack sudo[110206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:04 devstack sudo[110206]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" returned: 0 in 0.881s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:04 devstack sudo[110211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a Jun 25 18:25:04 devstack sudo[110211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:05 devstack sudo[110211]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a" returned: 0 in 0.806s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:05 devstack sudo[110217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a Jun 25 18:25:05 devstack sudo[110217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:05 devstack sudo[110217]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d.c73c2db3-0349-46ff-8d91-a9a3f837b65a" returned: 0 in 0.736s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-c73c2db3-0349-46ff-8d91-a9a3f837b65a" released by "_delete_snapshot" :: held 3.463s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" released by "delete_snapshot" :: held 3.490s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:06 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created reservations ['dc2022a1-b5bf-480d-b6e3-648439d9379c', 'a9ab22fa-721e-46a2-84b0-84aae9551570', 'f9b74699-30c6-41ac-9e62-0010830744b4', 'b289b717-5022-4061-a6ee-5bfdd644664e'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:06 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Delete snapshot completed successfully. Jun 25 18:25:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4deabac0-cbdc-414d-ba3a-4765866406c8 tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-c73c2db3-0349-46ff-8d91-a9a3f837b65a-delete_snapshot" released by "delete_snapshot" :: held 3.690s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-a659680e-dd1d-4bc4-9ad5-c191fefcc56d-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-a659680e-dd1d-4bc4-9ad5-c191fefcc56d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "cinder-quobyte-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" acquired by "delete_volume" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:06 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fcf773-8a9a-43a4-aeb8-b937b88215ca]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:07 devstack sudo[110221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d Jun 25 18:25:07 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:07 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" returned: 0 in 0.848s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:07 devstack sudo[110227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d Jun 25 18:25:07 devstack sudo[110227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:08 devstack sudo[110227]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" returned: 0 in 0.706s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-quobyte-a659680e-dd1d-4bc4-9ad5-c191fefcc56d" released by "delete_volume" :: held 1.638s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:08 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Created reservations ['6bfc6007-d68a-495f-a414-8acf70896afb', 'c8d8c261-3e2c-4f8d-9e2a-cf5bf937cca0', '1a20fa43-527e-4c54-bd7f-85d173cc20ef', '42f4ec4b-ac11-4d82-b388-2e7f8cdd3afd'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:08 devstack sudo[110230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:25:08 devstack sudo[110230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:09 devstack sudo[110230]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.875s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:09 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:09 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Deleted volume successfully. Jun 25 18:25:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-4dfcd763-93f3-4f92-b3c9-627d8fa8184b tempest-CreateVolumesFromSnapshotTest-1840258798 None] Lock "cinder-a659680e-dd1d-4bc4-9ad5-c191fefcc56d-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Flow 'volume_create_manager' (34793023-94ee-4cf1-a46d-d68c0c050020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df133097-a5fc-4667-a9cd-371975e50c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df133097-a5fc-4667-a9cd-371975e50c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ad06ee-4604-426a-8167-c501fbe503e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2618eb60e4974a40803b1a4e73c5fd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:16Z,use_quota=True,user_id='cc16b7767b89483ba369dfff9b16a8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd779615-86a4-4fed-b95c-302e54785e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd779615-86a4-4fed-b95c-302e54785e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d0d3de-dc79-4119-ae77-5ce9016cede9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.image.glance [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Creating Keystone auth plugin from conf {{(pid=93767) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d0d3de-dc79-4119-ae77-5ce9016cede9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81ad06ee-4604-426a-8167-c501fbe503e2', 'volume_name': 'volume-81ad06ee-4604-426a-8167-c501fbe503e2', 'volume_size': 1, 'image_id': '8007c034-a5fd-43e1-b231-57a5f9f2a672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8007c034-a5fd-43e1-b231-57a5f9f2a672', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0cec92de3321b6ba7a6d14a7358b6eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2618eb60e4974a40803b1a4e73c5fd36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a84c22fcf07e6b3e9ae479ee4977d9aa4032ca9c61de27b1c22759c7c5e70e367fa5e705c2aa5bfed084e8d07a7bd5b50dca963e5dc82f53476f5979f92c3d2', 'id': '8007c034-a5fd-43e1-b231-57a5f9f2a672', 'created_at': datetime.datetime(2026, 6, 25, 16, 25, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 25, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8007c034-a5fd-43e1-b231-57a5f9f2a672/file', 'properties': {}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2236875-ef2c-4784-90cb-9079e4a0b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2236875-ef2c-4784-90cb-9079e4a0b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e425828-485a-4f46-be9f-6ff609d54e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:16 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Volume 81ad06ee-4604-426a-8167-c501fbe503e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81ad06ee-4604-426a-8167-c501fbe503e2', 'volume_size': 1, 'image_id': '8007c034-a5fd-43e1-b231-57a5f9f2a672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8007c034-a5fd-43e1-b231-57a5f9f2a672', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0cec92de3321b6ba7a6d14a7358b6eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2618eb60e4974a40803b1a4e73c5fd36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a84c22fcf07e6b3e9ae479ee4977d9aa4032ca9c61de27b1c22759c7c5e70e367fa5e705c2aa5bfed084e8d07a7bd5b50dca963e5dc82f53476f5979f92c3d2', 'id': '8007c034-a5fd-43e1-b231-57a5f9f2a672', 'created_at': datetime.datetime(2026, 6, 25, 16, 25, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 25, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8007c034-a5fd-43e1-b231-57a5f9f2a672/file', 'properties': {}}, 'image_service': } Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Trying to clone 81ad06ee-4604-426a-8167-c501fbe503e2 from image 8007c034-a5fd-43e1-b231-57a5f9f2a672 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8007c034-a5fd-43e1-b231-57a5f9f2a672', 'metadata': {}}]). {{(pid=93767) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:25:16 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Image download 0.00 MB at 0.00 MB/s Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc142602-d4f0-4a53-9252-93568a3463e6]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:17 devstack sudo[110656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD Jun 25 18:25:17 devstack sudo[110656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:17 devstack sudo[110656]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:17 devstack sudo[110660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD Jun 25 18:25:17 devstack sudo[110660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:18 devstack sudo[110660]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.582s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Uploaded volume to glance image-id: 8fcc9e5c-dabd-488a-a3b3-cc557df9778a. {{(pid=93767) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1817}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.395s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1573747339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecc70f5-88b8-40ad-9797-e38a8902f3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f850610ea74e2cbef179cae4dc9a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:47Z,use_quota=True,user_id='7d31b0d8aba741ec8565d20899b919c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Creating volume 2ecc70f5-88b8-40ad-9797-e38a8902f3b3 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:25:18 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD" returned: 1 in 0.859s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Temporary image 8007c034-a5fd-43e1-b231-57a5f9f2a672 is fetched for user cc16b7767b89483ba369dfff9b16a8a1. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:25:18 devstack sudo[110665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 1073741824 Jun 25 18:25:18 devstack sudo[110665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a9a9960a-357d-4bcb-99f9-7166192854e7 tempest-VolumesActionsTest-1642425209 None] Copy volume to image completed successfully. Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[9221ae1c-a0a8-484f-a47d-d5b2c6b29e94]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:18 devstack sudo[110667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD Jun 25 18:25:18 devstack sudo[110667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:19 devstack sudo[110665]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 1073741824" returned: 0 in 0.881s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:19 devstack sudo[110667]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:19 devstack sudo[110675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 Jun 25 18:25:19 devstack sudo[110675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:19 devstack sudo[110674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD Jun 25 18:25:19 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:20 devstack sudo[110675]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" returned: 0 in 0.753s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Attempting download of cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}])) to volume 2ecc70f5-88b8-40ad-9797-e38a8902f3b3. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:25:20 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD" returned: 1 in 0.848s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ad06ee-4604-426a-8167-c501fbe503e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2618eb60e4974a40803b1a4e73c5fd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:16Z,use_quota=True,user_id='cc16b7767b89483ba369dfff9b16a8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Creating volume 81ad06ee-4604-426a-8167-c501fbe503e2 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:25:20 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:20 devstack sudo[110682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 1073741824 Jun 25 18:25:20 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9908509-9215-4ae6-b334-21da429dbe14]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_xsua674b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:20 devstack sudo[110684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_xsua674b Jun 25 18:25:20 devstack sudo[110684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:21 devstack sudo[110684]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_xsua674b" returned: 0 in 0.846s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_xsua674b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:21 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 1073741824" returned: 0 in 0.948s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:21 devstack sudo[110691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_xsua674b Jun 25 18:25:21 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:21 devstack sudo[110692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 Jun 25 18:25:21 devstack sudo[110692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:21 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_xsua674b" returned: 1 in 0.782s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_xsua674b' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:21 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1cd191-c3a2-496c-8ac4-9f7cbd00bd35]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:22 devstack sudo[110692]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2" returned: 0 in 0.716s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.322s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f27b06e-5f91-46a2-933f-5fe737830c06]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Attempting download of 8007c034-a5fd-43e1-b231-57a5f9f2a672 ((None, [{'url': 'file:///opt/stack/data/glance/images/8007c034-a5fd-43e1-b231-57a5f9f2a672', 'metadata': {}}])) to volume 81ad06ee-4604-426a-8167-c501fbe503e2. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:25:22 devstack sudo[110698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD Jun 25 18:25:22 devstack sudo[110698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab136e9-4f6f-4254-80b6-c0b2ca51f572]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8007c034-a5fd-43e1-b231-57a5f9f2a672_yh1k_zi4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:22 devstack sudo[110699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb Jun 25 18:25:22 devstack sudo[110699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:22 devstack sudo[110701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8007c034-a5fd-43e1-b231-57a5f9f2a672_yh1k_zi4 Jun 25 18:25:22 devstack sudo[110701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:22 devstack sudo[110698]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD" returned: 0 in 0.749s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f was qcow2, converting to raw {{(pid=93767) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:22 devstack sudo[110712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 Jun 25 18:25:22 devstack sudo[110712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:22 devstack sudo[110699]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb" returned: 0 in 0.835s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a87417-cb4a-49ca-aaaf-c54b14efa6e5]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:22 devstack sudo[110701]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8007c034-a5fd-43e1-b231-57a5f9f2a672_yh1k_zi4" returned: 0 in 0.785s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8007c034-a5fd-43e1-b231-57a5f9f2a672_yh1k_zi4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:22 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb Jun 25 18:25:23 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:23 devstack sudo[110717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8007c034-a5fd-43e1-b231-57a5f9f2a672_yh1k_zi4 Jun 25 18:25:23 devstack sudo[110717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:23 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb" returned: 0 in 0.813s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:23 devstack sudo[110717]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:23 devstack sudo[110730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img Jun 25 18:25:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8007c034-a5fd-43e1-b231-57a5f9f2a672_yh1k_zi4" returned: 1 in 0.838s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:23 devstack sudo[110730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8007c034-a5fd-43e1-b231-57a5f9f2a672_yh1k_zi4' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff56e08d-77d0-4b44-a8b7-a43784e89958]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:23 devstack sudo[110732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD Jun 25 18:25:23 devstack sudo[110732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:25 devstack sudo[110732]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD" returned: 0 in 1.393s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:25 devstack sudo[110747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD Jun 25 18:25:25 devstack sudo[110747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:25 devstack sudo[110712]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" returned: 0 in 2.843s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:25 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_zkptrbj_devstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:25:25 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Converted 112.00 MB image at 39.37 MB/s Jun 25 18:25:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:25 devstack sudo[110752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 1G Jun 25 18:25:25 devstack sudo[110752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:26 devstack sudo[110747]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD" returned: 1 in 1.794s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:26 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] 8007c034-a5fd-43e1-b231-57a5f9f2a672 was raw, converting to raw {{(pid=93767) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:25:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:27 devstack sudo[110757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 Jun 25 18:25:27 devstack sudo[110757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:28 devstack sudo[110752]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 1G" returned: 0 in 2.466s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:28 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80eb9c7-42f9-4c9d-8a40-b13a7e15f6d1]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:28 devstack sudo[110757]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:28 devstack sudo[110765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 Jun 25 18:25:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2" returned: 0 in 1.626s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:28 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8007c034-a5fd-43e1-b231-57a5f9f2a672_gvf1rjdbdevstack@QuobyteHD, size 0.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:25:28 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 18:25:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:28 devstack sudo[110765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:28 devstack sudo[110767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 1G Jun 25 18:25:28 devstack sudo[110767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:28 devstack sudo[110730]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img" returned: 0 in 5.275s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a617d7-0449-4aa8-a9f3-01e326c4ed7e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:29 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb Jun 25 18:25:29 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:29 devstack sudo[110765]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" returned: 0 in 1.311s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:29 devstack sudo[110767]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 1G" returned: 0 in 0.933s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[362e28dd-2cc4-4239-a338-e41334e00fba]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:29 devstack sudo[110776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 Jun 25 18:25:29 devstack sudo[110776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:29 devstack sudo[110777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 Jun 25 18:25:29 devstack sudo[110777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:29 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb" returned: 0 in 0.958s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:25:29 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Converted 1024.00 MB image at 194.10 MB/s Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] f205bd35-0511-48f5-9b09-8fda829d38c1 was raw, converting to qcow2 {{(pid=93767) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70722f9-090f-4986-9ba8-a81da1341a54]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:30 devstack sudo[110783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img Jun 25 18:25:30 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:30 devstack sudo[110776]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" returned: 1 in 0.846s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Downloaded image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}])) to volume 2ecc70f5-88b8-40ad-9797-e38a8902f3b3 successfully. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Temporary image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f for user 7d31b0d8aba741ec8565d20899b919c3 is deleted. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Marking volume 2ecc70f5-88b8-40ad-9797-e38a8902f3b3 as bootable. {{(pid=93767) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Copying metadata from image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f to 2ecc70f5-88b8-40ad-9797-e38a8902f3b3. {{(pid=93767) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Creating volume glance metadata for volume 2ecc70f5-88b8-40ad-9797-e38a8902f3b3 backed by image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93767) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:25:30 devstack sudo[110777]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2" returned: 0 in 0.859s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca506981-b87e-4d90-9bfb-bef3a9dde7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c07118-84ec-420b-a323-b761789f7585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:30 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Volume volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 (2ecc70f5-88b8-40ad-9797-e38a8902f3b3): created successfully Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c07118-84ec-420b-a323-b761789f7585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Flow 'volume_create_manager' (87ca1ddd-8f7b-4f3f-b30d-1fb9bc95e471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:30 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-cab0f209-586b-442b-9e66-b67225f3c817 tempest-VolumesImageMetadata-452990595 None] Created volume successfully. Jun 25 18:25:30 devstack sudo[110790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 Jun 25 18:25:30 devstack sudo[110790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:30 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img" returned: 0 in 0.790s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:30 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img Jun 25 18:25:30 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:31 devstack sudo[110790]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2" returned: 1 in 0.822s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Downloaded image 8007c034-a5fd-43e1-b231-57a5f9f2a672 ((None, [{'url': 'file:///opt/stack/data/glance/images/8007c034-a5fd-43e1-b231-57a5f9f2a672', 'metadata': {}}])) to volume 81ad06ee-4604-426a-8167-c501fbe503e2 successfully. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Temporary image 8007c034-a5fd-43e1-b231-57a5f9f2a672 for user cc16b7767b89483ba369dfff9b16a8a1 is deleted. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Marking volume 81ad06ee-4604-426a-8167-c501fbe503e2 as bootable. {{(pid=93767) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Copying metadata from image 8007c034-a5fd-43e1-b231-57a5f9f2a672 to 81ad06ee-4604-426a-8167-c501fbe503e2. {{(pid=93767) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Creating volume glance metadata for volume 81ad06ee-4604-426a-8167-c501fbe503e2 backed by image 8007c034-a5fd-43e1-b231-57a5f9f2a672 with: {'image_id': '8007c034-a5fd-43e1-b231-57a5f9f2a672', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a0cec92de3321b6ba7a6d14a7358b6eb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93767) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e425828-485a-4f46-be9f-6ff609d54e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ad06ee-4604-426a-8167-c501fbe503e2', 'volume_size': 1, 'image_id': '8007c034-a5fd-43e1-b231-57a5f9f2a672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8007c034-a5fd-43e1-b231-57a5f9f2a672', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0cec92de3321b6ba7a6d14a7358b6eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2618eb60e4974a40803b1a4e73c5fd36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a84c22fcf07e6b3e9ae479ee4977d9aa4032ca9c61de27b1c22759c7c5e70e367fa5e705c2aa5bfed084e8d07a7bd5b50dca963e5dc82f53476f5979f92c3d2', 'id': '8007c034-a5fd-43e1-b231-57a5f9f2a672', 'created_at': datetime.datetime(2026, 6, 25, 16, 25, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 25, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8007c034-a5fd-43e1-b231-57a5f9f2a672/file', 'properties': {}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c70405-7704-4d88-b3e3-620905dfeda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:31 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Volume volume-81ad06ee-4604-426a-8167-c501fbe503e2 (81ad06ee-4604-426a-8167-c501fbe503e2): created successfully Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c70405-7704-4d88-b3e3-620905dfeda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Flow 'volume_create_manager' (34793023-94ee-4cf1-a46d-d68c0c050020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a13c3baf-728e-45c9-96cf-182e5ea03b45 tempest-VolumeImageDependencyTests-1033447683 None] Created volume successfully. Jun 25 18:25:31 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img" returned: 1 in 0.890s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img /opt/stack/data/cinder/conversion/vol_upload_of6qcvhj {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:31 devstack sudo[110802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img /opt/stack/data/cinder/conversion/vol_upload_of6qcvhj Jun 25 18:25:31 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Acquiring lock "cinder-2ecc70f5-88b8-40ad-9797-e38a8902f3b3-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Lock "cinder-2ecc70f5-88b8-40ad-9797-e38a8902f3b3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Acquiring lock "cinder-quobyte-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Acquiring lock "cinder-81ad06ee-4604-426a-8167-c501fbe503e2-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Lock "cinder-quobyte-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" acquired by "delete_volume" :: waited 0.032s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Lock "cinder-81ad06ee-4604-426a-8167-c501fbe503e2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[db705a9d-854e-4389-88d3-03ea03a72ca4]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Acquiring lock "cinder-quobyte-81ad06ee-4604-426a-8167-c501fbe503e2" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Lock "cinder-quobyte-81ad06ee-4604-426a-8167-c501fbe503e2" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[576cc448-9ceb-440a-bad7-c0e79d3861d5]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:32 devstack sudo[110804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 Jun 25 18:25:32 devstack sudo[110804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:32 devstack sudo[110805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 Jun 25 18:25:32 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:32 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img /opt/stack/data/cinder/conversion/vol_upload_of6qcvhj" returned: 0 in 0.817s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Image conversion details: src /opt/stack/data/cinder/conversion/c05fa30e-c503-46f2-acae-5061b8505afb.temp_image.f205bd35-0511-48f5-9b09-8fda829d38c1iosga1oc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_of6qcvhj {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:25:32 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eff9be-915e-4f86-97e0-15aad52aff1f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_of6qcvhj {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:32 devstack sudo[110811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_of6qcvhj Jun 25 18:25:32 devstack sudo[110811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:32 devstack sudo[110804]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" returned: 0 in 0.873s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:32 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2" returned: 0 in 0.833s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:32 devstack sudo[110818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 Jun 25 18:25:32 devstack sudo[110818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:33 devstack sudo[110819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 Jun 25 18:25:33 devstack sudo[110819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:33 devstack sudo[110811]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_of6qcvhj" returned: 0 in 0.842s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:33 devstack sudo[110818]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" returned: 1 in 0.860s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:33 devstack sudo[110819]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2" returned: 1 in 0.835s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:33 devstack sudo[110831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3 Jun 25 18:25:33 devstack sudo[110831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:33 devstack sudo[110832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2 Jun 25 18:25:33 devstack sudo[110832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:34 devstack sudo[110832]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-81ad06ee-4604-426a-8167-c501fbe503e2" returned: 0 in 0.690s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Lock "cinder-quobyte-81ad06ee-4604-426a-8167-c501fbe503e2" released by "delete_volume" :: held 2.432s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:34 devstack sudo[110831]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" returned: 0 in 0.750s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Lock "cinder-quobyte-2ecc70f5-88b8-40ad-9797-e38a8902f3b3" released by "delete_volume" :: held 2.596s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Created reservations ['c1f30923-29fc-4ba2-81e3-7921a37f5d7d', 'fee0bbec-1bb8-4e6f-8004-e01c95f5c6c4', '334456dd-f1c8-44c5-acb2-8100e9326d17', 'f23e3ee2-f5ec-450b-bae7-d40489b008ac'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Created reservations ['debc5a91-83c5-446e-8f8a-26330b8bc3c6', '621b0f5d-0686-4182-9621-02ef050c6680', '7af2a405-b524-49fd-aced-10f1e9e87482', 'e91f4b39-1a3f-4485-8ac2-552de172a336'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:34 devstack sudo[110837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:25:34 devstack sudo[110837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:34 devstack sudo[110839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:25:34 devstack sudo[110839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.938s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:34 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Uploaded volume to glance image-id: f205bd35-0511-48f5-9b09-8fda829d38c1. {{(pid=93767) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1817}} Jun 25 18:25:34 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f05b69a7-2cb2-485b-8787-1eeac720569f tempest-VolumesActionsTest-1642425209 None] Copy volume to image completed successfully. Jun 25 18:25:35 devstack sudo[110837]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.759s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:35 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Deleted volume successfully. Jun 25 18:25:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-15341adf-9ac7-4e5c-be52-f5a9b0919ea7 tempest-VolumeImageDependencyTests-1033447683 None] Lock "cinder-81ad06ee-4604-426a-8167-c501fbe503e2-delete_volume" released by "delete_volume" :: held 3.515s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:35 devstack sudo[110839]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.814s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:35 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Deleted volume successfully. Jun 25 18:25:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-078a3a8e-32de-429f-8047-9df8f4a86132 tempest-VolumesImageMetadata-452990595 None] Lock "cinder-2ecc70f5-88b8-40ad-9797-e38a8902f3b3-delete_volume" released by "delete_volume" :: held 3.775s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Acquiring lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Acquiring lock "cinder-quobyte-c05fa30e-c503-46f2-acae-5061b8505afb" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Lock "cinder-quobyte-c05fa30e-c503-46f2-acae-5061b8505afb" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:36 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[db28bcd8-c40a-41ac-b0cd-c4c7da387890]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:36 devstack sudo[110843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb Jun 25 18:25:36 devstack sudo[110843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:37 devstack sudo[110843]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb" returned: 0 in 0.922s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:37 devstack sudo[110848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb Jun 25 18:25:37 devstack sudo[110848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:38 devstack sudo[110848]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-c05fa30e-c503-46f2-acae-5061b8505afb" returned: 0 in 0.765s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Lock "cinder-quobyte-c05fa30e-c503-46f2-acae-5061b8505afb" released by "delete_volume" :: held 1.737s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=108,cinder:SELECT=83,cinder:INSERT=38,cinder:DELETE=5 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Created reservations ['2a2d467b-1b37-4e73-b67c-4655db9c954a', '33e90e3c-01e4-4e8d-8107-fbc52de43859', 'f88789dc-2ac4-4ec5-a875-e72b4f01369c', 'dba6ece9-ddbd-4502-adbf-58cddff801f9'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:38 devstack sudo[110851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:25:38 devstack sudo[110851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:38 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Flow 'volume_create_manager' (d6ece5a2-0470-4a27-9807-9629cbfcd526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b7c30c-91d1-458d-9a96-707711d4e2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b7c30c-91d1-458d-9a96-707711d4e2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-203765541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de98bca-a4d9-44ac-ae84-315ee3f386bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce47ab5e0f524c44b1e70020e458f5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:39Z,use_quota=True,user_id='e62d0ef987d94684b3def35211c76e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055bf7a2-1537-4620-bb0f-987d1d6a2693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055bf7a2-1537-4620-bb0f-987d1d6a2693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49ced13-f0a1-4885-84e0-d09ee8558f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49ced13-f0a1-4885-84e0-d09ee8558f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de98bca-a4d9-44ac-ae84-315ee3f386bc', 'volume_name': 'volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc', 'volume_size': 2}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c83dc1d-72db-4093-b1f8-1363504d7058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c83dc1d-72db-4093-b1f8-1363504d7058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e5bad-bd4f-4e62-b3eb-387a6825cb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:39 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Volume 6de98bca-a4d9-44ac-ae84-315ee3f386bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc', 'volume_size': 2} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-203765541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de98bca-a4d9-44ac-ae84-315ee3f386bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce47ab5e0f524c44b1e70020e458f5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:39Z,use_quota=True,user_id='e62d0ef987d94684b3def35211c76e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Creating volume 6de98bca-a4d9-44ac-ae84-315ee3f386bc {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:25:39 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc 2147483648 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:39 devstack sudo[110851]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.895s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Deleted volume successfully. Jun 25 18:25:39 devstack sudo[110854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc 2147483648 Jun 25 18:25:39 devstack sudo[110854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e3c9ba1a-40c6-4008-b1bd-7ee504020704 tempest-VolumesActionsTest-1642425209 None] Lock "cinder-c05fa30e-c503-46f2-acae-5061b8505afb-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:40 devstack sudo[110854]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc 2147483648" returned: 0 in 1.102s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:40 devstack sudo[110860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc Jun 25 18:25:40 devstack sudo[110860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:25:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:40 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:25:40 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:41 devstack sudo[110860]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc" returned: 0 in 0.832s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e5bad-bd4f-4e62-b3eb-387a6825cb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc', 'volume_size': 2}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c850871-3d2f-4f0d-b177-409ce35ad927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:41 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Volume volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc (6de98bca-a4d9-44ac-ae84-315ee3f386bc): created successfully Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c850871-3d2f-4f0d-b177-409ce35ad927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Flow 'volume_create_manager' (d6ece5a2-0470-4a27-9807-9629cbfcd526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:41 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-be00da69-870f-4634-843e-b66d665a58cc tempest-VolumesCloneNegativeTest-634216427 None] Created volume successfully. Jun 25 18:25:41 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.781s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:25:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:25:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Acquiring lock "cinder-6de98bca-a4d9-44ac-ae84-315ee3f386bc-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Lock "cinder-6de98bca-a4d9-44ac-ae84-315ee3f386bc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Acquiring lock "cinder-quobyte-6de98bca-a4d9-44ac-ae84-315ee3f386bc" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Lock "cinder-quobyte-6de98bca-a4d9-44ac-ae84-315ee3f386bc" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:42 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[03370024-b9f6-4794-8c22-7f565acd79df]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:42 devstack sudo[110867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc Jun 25 18:25:42 devstack sudo[110867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:43 devstack sudo[110867]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc" returned: 0 in 0.968s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:43 devstack sudo[110874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc Jun 25 18:25:43 devstack sudo[110874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:44 devstack sudo[110874]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6de98bca-a4d9-44ac-ae84-315ee3f386bc" returned: 0 in 0.845s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Lock "cinder-quobyte-6de98bca-a4d9-44ac-ae84-315ee3f386bc" released by "delete_volume" :: held 1.867s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:44 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Created reservations ['072976ec-3a3b-4a75-8175-ad243ca55c84', '73f0d893-8688-45cc-acc7-b1bb3508bc20', '9abd9b12-80a3-4b1a-b04c-4ef2d7abb0e1', '70ef050a-8fb2-4f60-acfc-e408fecc0ad0'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:44 devstack sudo[110877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:25:44 devstack sudo[110877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:45 devstack sudo[110877]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.027s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:45 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Deleted volume successfully. Jun 25 18:25:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-35b9bb08-6a32-4495-8d81-e9df78623dfa tempest-VolumesCloneNegativeTest-634216427 None] Lock "cinder-6de98bca-a4d9-44ac-ae84-315ee3f386bc-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:47 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:25:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Flow 'volume_create_manager' (a0fbef81-ea3e-4110-a335-60638e75b7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c51800c-85c4-46c0-8487-c305d829a077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c51800c-85c4-46c0-8487-c305d829a077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-144516359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68599d70-2582-4bb0-b14c-fa9e5b2d67e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7be222b8ab4fa09e82fece4080d045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:48Z,use_quota=True,user_id='84cbdafed1954b2fad8c9cf869e9db05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce63141-b6fc-4043-bd8f-0407942f83f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce63141-b6fc-4043-bd8f-0407942f83f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d61b576-d435-4fbf-90db-1cddd921b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:47 devstack cinder-volume[93767]: DEBUG cinder.image.glance [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Creating Keystone auth plugin from conf {{(pid=93767) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:25:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d61b576-d435-4fbf-90db-1cddd921b959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68599d70-2582-4bb0-b14c-fa9e5b2d67e4', 'volume_name': 'volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f621bfae-c167-4fd4-b715-17668ecd5331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f621bfae-c167-4fd4-b715-17668ecd5331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb952e39-6e7d-442e-917f-50c421bbc05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Volume 68599d70-2582-4bb0-b14c-fa9e5b2d67e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 18:25:48 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Trying to clone 68599d70-2582-4bb0-b14c-fa9e5b2d67e4 from image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]). {{(pid=93767) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:25:48 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:25:48 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Image download 20.69 MB at 20.69 MB/s Jun 25 18:25:48 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ada1f4-d221-41c7-a35a-e619bcc237ce]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:49 devstack sudo[110882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD Jun 25 18:25:49 devstack sudo[110882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Flow 'volume_create_manager' (b076070d-9999-439f-8c02-ff6445ec146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b0f854-f556-409e-9880-ae488ca56ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b0f854-f556-409e-9880-ae488ca56ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-84247385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f4f517-3a08-4115-97b2-72e1ecff366b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75fe794ecc05451b9c50510c485eae96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:49Z,use_quota=True,user_id='96017ef6c7744c8d8d5464969aa0a216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffb9aae-97d6-4906-9b3f-c5c50f9bec60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffb9aae-97d6-4906-9b3f-c5c50f9bec60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59654dd-51c5-4cca-8599-16c61ccbbad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59654dd-51c5-4cca-8599-16c61ccbbad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f4f517-3a08-4115-97b2-72e1ecff366b', 'volume_name': 'volume-01f4f517-3a08-4115-97b2-72e1ecff366b', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb606a92-38ec-4f5c-a63d-83e038226f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb606a92-38ec-4f5c-a63d-83e038226f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3810119-4e00-493e-8faa-f2c9fc5390b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:49 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Volume 01f4f517-3a08-4115-97b2-72e1ecff366b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f4f517-3a08-4115-97b2-72e1ecff366b', 'volume_size': 1} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-84247385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f4f517-3a08-4115-97b2-72e1ecff366b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75fe794ecc05451b9c50510c485eae96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:49Z,use_quota=True,user_id='96017ef6c7744c8d8d5464969aa0a216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Creating volume 01f4f517-3a08-4115-97b2-72e1ecff366b {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:25:49 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:25:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:49 devstack sudo[110884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b 1073741824 Jun 25 18:25:49 devstack sudo[110884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:50 devstack sudo[110882]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD" returned: 0 in 1.117s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:50 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Temporary image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f is fetched for user 84cbdafed1954b2fad8c9cf869e9db05. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:25:50 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62a3e2-438e-4c4b-8c4e-15f4755b5d02]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:50 devstack sudo[110889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD Jun 25 18:25:50 devstack sudo[110889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:50 devstack sudo[110884]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b 1073741824" returned: 0 in 1.468s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:51 devstack sudo[110931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b Jun 25 18:25:51 devstack sudo[110931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:51 devstack sudo[110889]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD" returned: 0 in 0.999s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:51 devstack sudo[110931]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b" returned: 0 in 0.700s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-144516359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68599d70-2582-4bb0-b14c-fa9e5b2d67e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7be222b8ab4fa09e82fece4080d045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:48Z,use_quota=True,user_id='84cbdafed1954b2fad8c9cf869e9db05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Creating volume 68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:25:51 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3810119-4e00-493e-8faa-f2c9fc5390b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f4f517-3a08-4115-97b2-72e1ecff366b', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:51 devstack sudo[110936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 1073741824 Jun 25 18:25:51 devstack sudo[110936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454aac81-4507-461f-b515-18361a501c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:51 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Volume volume-01f4f517-3a08-4115-97b2-72e1ecff366b (01f4f517-3a08-4115-97b2-72e1ecff366b): created successfully Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454aac81-4507-461f-b515-18361a501c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Flow 'volume_create_manager' (b076070d-9999-439f-8c02-ff6445ec146c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-3b5820b7-3360-44c1-87a5-1176d3431b77 tempest-VolumesNegativeTest-26467911 None] Created volume successfully. Jun 25 18:25:52 devstack sudo[110936]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 1073741824" returned: 0 in 1.099s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:52 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 Jun 25 18:25:52 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:53 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" returned: 0 in 0.902s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:25:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:53 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Attempting download of cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}])) to volume 68599d70-2582-4bb0-b14c-fa9e5b2d67e4. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:25:53 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d5c79-ea56-4d5f-a36c-9d8d23acc560]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_ymojgc88 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:54 devstack sudo[110949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_ymojgc88 Jun 25 18:25:54 devstack sudo[110949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:54 devstack sudo[110949]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_ymojgc88" returned: 0 in 0.964s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_ymojgc88 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:55 devstack sudo[110954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_ymojgc88 Jun 25 18:25:55 devstack sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:55 devstack sudo[110954]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_ymojgc88" returned: 1 in 0.865s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_ymojgc88' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:25:55 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa0805-5373-4ae1-9e25-fa6b882b59eb]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:55 devstack sudo[110958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD Jun 25 18:25:55 devstack sudo[110958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:56 devstack sudo[110958]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD" returned: 0 in 1.005s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:56 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f was qcow2, converting to raw {{(pid=93767) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:25:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:56 devstack sudo[110963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 Jun 25 18:25:56 devstack sudo[110963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:59 devstack sudo[110963]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" returned: 0 in 2.836s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:59 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f_9tin75q8devstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:25:59 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Converted 112.00 MB image at 39.47 MB/s Jun 25 18:25:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:59 devstack sudo[110971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 1G Jun 25 18:25:59 devstack sudo[110971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:00 devstack sudo[110971]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 1G" returned: 0 in 0.848s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:00 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea685d2c-4b23-48d3-8e1d-b02cd606801e]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:00 devstack sudo[110977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 Jun 25 18:26:00 devstack sudo[110977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:01 devstack sudo[110977]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" returned: 0 in 1.164s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:01 devstack sudo[110981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 Jun 25 18:26:01 devstack sudo[110981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:02 devstack sudo[110981]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" returned: 1 in 1.097s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:26:02 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Downloaded image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}])) to volume 68599d70-2582-4bb0-b14c-fa9e5b2d67e4 successfully. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:26:02 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Temporary image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f for user 84cbdafed1954b2fad8c9cf869e9db05 is deleted. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:26:02 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Marking volume 68599d70-2582-4bb0-b14c-fa9e5b2d67e4 as bootable. {{(pid=93767) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:26:02 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Copying metadata from image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f to 68599d70-2582-4bb0-b14c-fa9e5b2d67e4. {{(pid=93767) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:26:02 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Creating volume glance metadata for volume 68599d70-2582-4bb0-b14c-fa9e5b2d67e4 backed by image cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93767) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:26:02 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=71,cinder:SELECT=56,cinder:DELETE=5,cinder:INSERT=23 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:26:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb952e39-6e7d-442e-917f-50c421bbc05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4', 'volume_size': 1, 'image_id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e6508013eb148fa8bba4d3363a43e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f', 'created_at': datetime.datetime(2026, 6, 25, 16, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6b89f4-0a07-4540-a8d2-b16a93c0fe4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff9be43-bcb7-49a1-9fc5-7826285d9e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:03 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Volume volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 (68599d70-2582-4bb0-b14c-fa9e5b2d67e4): created successfully Jun 25 18:26:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff9be43-bcb7-49a1-9fc5-7826285d9e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Flow 'volume_create_manager' (a0fbef81-ea3e-4110-a335-60638e75b7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:03 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d1eb983e-6010-423b-b49b-cb0b824bab31 tempest-VolumesExtendTest-799608423 None] Created volume successfully. Jun 25 18:26:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:04 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4c3121-1d5a-47ae-9475-4d49fc4da8f2]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:04 devstack sudo[111004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 Jun 25 18:26:04 devstack sudo[111004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:05 devstack sudo[111004]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" returned: 0 in 0.823s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:05 devstack sudo[111008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 Jun 25 18:26:05 devstack sudo[111008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:06 devstack sudo[111008]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" returned: 1 in 0.983s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 2G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 2G" returned: 0 in 0.077s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.977s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:06 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-3ac6167f-1da8-4939-87a9-7dabe252152c tempest-VolumesExtendTest-799608423 None] Extend volume completed successfully. Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Acquiring lock "cinder-68599d70-2582-4bb0-b14c-fa9e5b2d67e4-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Lock "cinder-68599d70-2582-4bb0-b14c-fa9e5b2d67e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Acquiring lock "cinder-quobyte-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Lock "cinder-quobyte-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6a5455-53a7-49fa-a5d4-cee28c804513]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:06 devstack sudo[111020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 Jun 25 18:26:06 devstack sudo[111020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Flow 'volume_create_manager' (ed5cf391-e638-4bff-ba05-c6c48f4f7440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa67690f-d47d-4d6d-b5bc-05c52a4f19a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa67690f-d47d-4d6d-b5bc-05c52a4f19a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-30362897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e614be7c-28af-4b93-a1bd-6777970c90d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550feb5fb73d4402a6e7334331073433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:26:07Z,use_quota=True,user_id='0a3b8ef305ff4985bc383d106003250e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2244d1f5-ca52-4f17-8fea-c57ae855fa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2244d1f5-ca52-4f17-8fea-c57ae855fa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689c6235-7684-4b1a-9793-4e29609b2c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689c6235-7684-4b1a-9793-4e29609b2c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e614be7c-28af-4b93-a1bd-6777970c90d8', 'volume_name': 'volume-e614be7c-28af-4b93-a1bd-6777970c90d8', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537bc89c-0612-4d0d-9539-3330e906d4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537bc89c-0612-4d0d-9539-3330e906d4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60a4653-f004-47e1-b171-fd153299d2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:07 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Volume e614be7c-28af-4b93-a1bd-6777970c90d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e614be7c-28af-4b93-a1bd-6777970c90d8', 'volume_size': 1} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-30362897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e614be7c-28af-4b93-a1bd-6777970c90d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550feb5fb73d4402a6e7334331073433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:26:07Z,use_quota=True,user_id='0a3b8ef305ff4985bc383d106003250e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Creating volume e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:26:07 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:07 devstack sudo[111022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 1073741824 Jun 25 18:26:07 devstack sudo[111022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:07 devstack sudo[111020]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" returned: 0 in 0.851s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:07 devstack sudo[111026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 Jun 25 18:26:07 devstack sudo[111026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:08 devstack sudo[111022]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 1073741824" returned: 0 in 0.890s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:08 devstack sudo[111034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 Jun 25 18:26:08 devstack sudo[111034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:08 devstack sudo[111026]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" returned: 1 in 0.908s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:26:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:08 devstack sudo[111046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4 Jun 25 18:26:08 devstack sudo[111046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:09 devstack sudo[111034]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8" returned: 0 in 1.004s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60a4653-f004-47e1-b171-fd153299d2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e614be7c-28af-4b93-a1bd-6777970c90d8', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567a3c76-f93b-422b-a0e0-76f86cadfb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:09 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Volume volume-e614be7c-28af-4b93-a1bd-6777970c90d8 (e614be7c-28af-4b93-a1bd-6777970c90d8): created successfully Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567a3c76-f93b-422b-a0e0-76f86cadfb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Flow 'volume_create_manager' (ed5cf391-e638-4bff-ba05-c6c48f4f7440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:09 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-575f463b-c529-471b-8e41-0d5e2817ac07 tempest-SnapshotDependencyTests-1489603635 None] Created volume successfully. Jun 25 18:26:09 devstack sudo[111046]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" returned: 0 in 0.979s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Lock "cinder-quobyte-68599d70-2582-4bb0-b14c-fa9e5b2d67e4" released by "delete_volume" :: held 2.833s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Created reservations ['86b08de1-a14b-44b8-9723-c4526bacef96', '8d134a22-a6fd-4d4e-a53c-0e9744a24daf', '21f5d231-2a1b-4e84-91ba-abcd70afecfe', '0d674262-e5f6-4657-9a54-19d910eb0c30'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:09 devstack sudo[111117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:26:09 devstack sudo[111117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Flow 'volume_create_manager' (98f5063d-73a8-43f2-8285-b72fc0a991ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a271d4-77e8-4ec3-b074-35f9575467ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a271d4-77e8-4ec3-b074-35f9575467ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1474125365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7be222b8ab4fa09e82fece4080d045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:26:11Z,use_quota=True,user_id='84cbdafed1954b2fad8c9cf869e9db05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5db1d9-2233-4b49-9918-d736e236bf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5db1d9-2233-4b49-9918-d736e236bf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7aaaf3d-2650-44d8-af6e-1507b90be9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7aaaf3d-2650-44d8-af6e-1507b90be9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd', 'volume_name': 'volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:10 devstack sudo[111117]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd4c7eb-9ec3-4a07-bf13-bac0441b693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd4c7eb-9ec3-4a07-bf13-bac0441b693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0085ac4-c1dc-491d-887a-62e665ee5802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:10 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Volume 18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd', 'volume_size': 1} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1474125365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7be222b8ab4fa09e82fece4080d045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:26:11Z,use_quota=True,user_id='84cbdafed1954b2fad8c9cf869e9db05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Creating volume 18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:26:10 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.999s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:26:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Deleted volume successfully. Jun 25 18:26:10 devstack sudo[111120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd 1073741824 Jun 25 18:26:10 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-75eb5484-e777-4740-8c19-05a04bd786a6 tempest-VolumesExtendTest-799608423 None] Lock "cinder-68599d70-2582-4bb0-b14c-fa9e5b2d67e4-delete_volume" released by "delete_volume" :: held 4.170s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:11 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd 1073741824" returned: 0 in 0.964s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:11 devstack sudo[111126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd Jun 25 18:26:11 devstack sudo[111126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:12 devstack sudo[111126]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" returned: 0 in 0.711s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.657s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0085ac4-c1dc-491d-887a-62e665ee5802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3463662-8b73-4a73-869a-b79c39d47ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Creating offline snapshot 1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 of volume e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:26:12 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Volume volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd (18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd): created successfully Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3463662-8b73-4a73-869a-b79c39d47ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Flow 'volume_create_manager' (98f5063d-73a8-43f2-8285-b72fc0a991ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50b1e65-e763-4d25-a90c-257e276c5b5b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:12 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8a0a5fd9-6452-4ce0-9570-4ab23f872138 tempest-VolumesExtendTest-799608423 None] Created volume successfully. Jun 25 18:26:12 devstack sudo[111130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 Jun 25 18:26:12 devstack sudo[111130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:13 devstack sudo[111130]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8" returned: 0 in 1.187s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:13 devstack sudo[111145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 1G Jun 25 18:26:13 devstack sudo[111145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:14 devstack sudo[111145]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 1G" returned: 0 in 0.960s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e614be7c-28af-4b93-a1bd-6777970c90d8 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:14 devstack sudo[111151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e614be7c-28af-4b93-a1bd-6777970c90d8 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 Jun 25 18:26:14 devstack sudo[111151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:15 devstack sudo[111151]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e614be7c-28af-4b93-a1bd-6777970c90d8 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0" returned: 0 in 0.810s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:15 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 is being set with open permissions: ugo+rw Jun 25 18:26:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:15 devstack sudo[111169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 Jun 25 18:26:15 devstack sudo[111169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:16 devstack sudo[111169]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0" returned: 0 in 0.795s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:16 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.info Jun 25 18:26:16 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:17 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.info" returned: 0 in 0.739s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:17 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.info is being set with open permissions: ugo+rw Jun 25 18:26:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:17 devstack sudo[111207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.info Jun 25 18:26:17 devstack sudo[111207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:18 devstack sudo[111207]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.info" returned: 0 in 0.846s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.484s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.831s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Creating offline snapshot 54a064d9-08c6-4de4-80c0-6a41f53644c0 of volume 18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:26:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a656869f-9fda-4d84-a08f-667823ebcec3 tempest-SnapshotDependencyTests-1489603635 None] Create snapshot completed successfully Jun 25 18:26:18 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0765798-fc0c-4815-8364-d1715d69cdf1]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:18 devstack sudo[111211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd Jun 25 18:26:18 devstack sudo[111211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:18 devstack sudo[111211]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:18 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" returned: 0 in 0.920s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:19 devstack sudo[111216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 1G Jun 25 18:26:19 devstack sudo[111216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Flow 'volume_create_manager' (168f191a-15fd-4288-ab52-73c3886386a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbc900d-5673-4200-9dd4-d9ae52990a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbc900d-5673-4200-9dd4-d9ae52990a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51038c01-6e86-445c-8c56-785a43ee915f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550feb5fb73d4402a6e7334331073433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:26:19Z,use_quota=True,user_id='0a3b8ef305ff4985bc383d106003250e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f405355-76e1-4328-a274-14ca06c4f21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f405355-76e1-4328-a274-14ca06c4f21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66d7c7a-ab31-4f5a-9082-5d140134c0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66d7c7a-ab31-4f5a-9082-5d140134c0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51038c01-6e86-445c-8c56-785a43ee915f', 'volume_name': 'volume-51038c01-6e86-445c-8c56-785a43ee915f', 'volume_size': 1, 'snapshot_id': '1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6ad1ee-fc01-42ab-b11e-5253d8eb864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6ad1ee-fc01-42ab-b11e-5253d8eb864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244f5090-3a8e-4fd4-9de8-1b78994b8145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:19 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Volume 51038c01-6e86-445c-8c56-785a43ee915f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51038c01-6e86-445c-8c56-785a43ee915f', 'volume_size': 1, 'snapshot_id': '1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0'} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:19 devstack sudo[111216]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 1G" returned: 0 in 0.886s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:19 devstack sudo[111221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 Jun 25 18:26:19 devstack sudo[111221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:20 devstack sudo[111221]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0" returned: 0 in 0.729s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:20 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 is being set with open permissions: ugo+rw Jun 25 18:26:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:20 devstack sudo[111226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 Jun 25 18:26:20 devstack sudo[111226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:21 devstack sudo[111226]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0" returned: 0 in 0.649s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:21 devstack sudo[111229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.info Jun 25 18:26:21 devstack sudo[111229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:22 devstack sudo[111229]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.info" returned: 0 in 0.710s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:22 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.info is being set with open permissions: ugo+rw Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:22 devstack sudo[111232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.info Jun 25 18:26:22 devstack sudo[111232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:22 devstack sudo[111232]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.info" returned: 0 in 0.723s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.720s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.636s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "cinder-quobyte-1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0-51038c01-6e86-445c-8c56-785a43ee915f" by "_create_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0-51038c01-6e86-445c-8c56-785a43ee915f" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Creating volume 51038c01-6e86-445c-8c56-785a43ee915f from snapshot 1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 {{(pid=93767) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "cinder-quobyte-51038c01-6e86-445c-8c56-785a43ee915f" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c1da40fa-13ec-4c6c-b7f9-c989741c9437 tempest-VolumesExtendTest-799608423 None] Create snapshot completed successfully Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-51038c01-6e86-445c-8c56-785a43ee915f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] snapshot: 1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0, volume: 51038c01-6e86-445c-8c56-785a43ee915f, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[35321a9e-c2e6-4d95-b4da-e2a7d671866b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:23 devstack sudo[111237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 Jun 25 18:26:23 devstack sudo[111237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:23 devstack sudo[111237]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d2ddbe43-1d7b-4942-af3c-7902ac101e27 tempest-VolumesExtendTest-799608423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0" returned: 0 in 0.879s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e614be7c-28af-4b93-a1bd-6777970c90d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:26:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:26:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:26:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1c312d-ff73-47ca-b846-3596f8e18e07]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:23 devstack sudo[111242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 Jun 25 18:26:23 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:24 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8" returned: 0 in 0.841s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:24 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:26:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:24 devstack sudo[111248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f Jun 25 18:26:24 devstack sudo[111248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:29 devstack sudo[111248]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f" returned: 0 in 5.157s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[99111edd-ff4a-415a-9657-582a371743f3]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:29 devstack sudo[111265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 Jun 25 18:26:29 devstack sudo[111265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:30 devstack sudo[111265]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8" returned: 0 in 0.996s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:30 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:26:30 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Converted 1024.00 MB image at 198.53 MB/s Jun 25 18:26:30 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f is being set with open permissions: ugo+rw Jun 25 18:26:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:30 devstack sudo[111270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f Jun 25 18:26:30 devstack sudo[111270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Acquiring lock "cinder-01f4f517-3a08-4115-97b2-72e1ecff366b-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Lock "cinder-01f4f517-3a08-4115-97b2-72e1ecff366b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Acquiring lock "cinder-quobyte-01f4f517-3a08-4115-97b2-72e1ecff366b" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Lock "cinder-quobyte-01f4f517-3a08-4115-97b2-72e1ecff366b" acquired by "delete_volume" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[505e80b4-4bdc-488a-ae8b-7166e1f783cd]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:31 devstack sudo[111272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b Jun 25 18:26:31 devstack sudo[111272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:31 devstack sudo[111270]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f" returned: 0 in 0.723s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-51038c01-6e86-445c-8c56-785a43ee915f" released by "_copy_volume_from_snapshot" :: held 8.724s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0-51038c01-6e86-445c-8c56-785a43ee915f" released by "_create_volume_from_snapshot" :: held 8.771s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.797s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d2ddbe43-1d7b-4942-af3c-7902ac101e27 tempest-VolumesExtendTest-799608423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.788s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[804335d7-837f-47a5-985d-3366e583c005]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d2ddbe43-1d7b-4942-af3c-7902ac101e27 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244f5090-3a8e-4fd4-9de8-1b78994b8145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51038c01-6e86-445c-8c56-785a43ee915f', 'volume_size': 1, 'snapshot_id': '1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc0e010-ea5a-448f-9ed6-6bd925e38d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:31 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Volume volume-51038c01-6e86-445c-8c56-785a43ee915f (51038c01-6e86-445c-8c56-785a43ee915f): created successfully Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc0e010-ea5a-448f-9ed6-6bd925e38d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:31 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Flow 'volume_create_manager' (168f191a-15fd-4288-ab52-73c3886386a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a88ba76c-bfab-47d7-b4aa-be56d87cc016 tempest-SnapshotDependencyTests-1489603635 None] Created volume successfully. Jun 25 18:26:31 devstack sudo[111275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd Jun 25 18:26:31 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:32 devstack sudo[111272]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b" returned: 0 in 0.852s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:32 devstack sudo[111280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b Jun 25 18:26:32 devstack sudo[111280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "cinder-1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "cinder-quobyte-e614be7c-28af-4b93-a1bd-6777970c90d8" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-e614be7c-28af-4b93-a1bd-6777970c90d8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "cinder-quobyte-1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Deleting offline snapshot 1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 of volume e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] snapshot_file for this snap is: volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e5a25-f225-42e3-86ec-222d97a76ddb]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:32 devstack sudo[111282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 Jun 25 18:26:32 devstack sudo[111282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:32 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d2ddbe43-1d7b-4942-af3c-7902ac101e27 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" returned: 0 in 0.848s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d2ddbe43-1d7b-4942-af3c-7902ac101e27 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 2G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d2ddbe43-1d7b-4942-af3c-7902ac101e27 tempest-VolumesExtendTest-799608423 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 2G" returned: 0 in 0.115s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d2ddbe43-1d7b-4942-af3c-7902ac101e27 tempest-VolumesExtendTest-799608423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:32 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d2ddbe43-1d7b-4942-af3c-7902ac101e27 tempest-VolumesExtendTest-799608423 None] Extend volume completed successfully. Jun 25 18:26:32 devstack sudo[111280]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-01f4f517-3a08-4115-97b2-72e1ecff366b" returned: 0 in 0.722s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Lock "cinder-quobyte-01f4f517-3a08-4115-97b2-72e1ecff366b" released by "delete_volume" :: held 1.614s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Created reservations ['f60bff66-86f9-4e55-b9b6-f33848809e1a', 'ccc9dae8-170d-43b1-85d2-ec0b95fecc02', '2dd361c9-439c-4cd2-a842-5f9660be2f4f', '19a5307f-0bb3-4269-959f-559f7ba2d1fe'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:32 devstack sudo[111295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:26:32 devstack sudo[111295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Acquiring lock "cinder-54a064d9-08c6-4de4-80c0-6a41f53644c0-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Lock "cinder-54a064d9-08c6-4de4-80c0-6a41f53644c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Acquiring lock "cinder-quobyte-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Lock "cinder-quobyte-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Acquiring lock "cinder-quobyte-54a064d9-08c6-4de4-80c0-6a41f53644c0" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:33 devstack sudo[111282]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0" returned: 0 in 0.872s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e614be7c-28af-4b93-a1bd-6777970c90d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Lock "cinder-quobyte-54a064d9-08c6-4de4-80c0-6a41f53644c0" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Deleting offline snapshot 54a064d9-08c6-4de4-80c0-6a41f53644c0 of volume 18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] snapshot_file for this snap is: volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e4b566-7a04-4f9f-8d58-7549d8ae13a6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f751e1ca-b111-46dd-b8fc-e72925a9fec9]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:33 devstack sudo[111297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 Jun 25 18:26:33 devstack sudo[111297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:33 devstack sudo[111298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 Jun 25 18:26:33 devstack sudo[111298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:33 devstack sudo[111295]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.781s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:26:33 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Deleted volume successfully. Jun 25 18:26:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a6f5064b-affd-4fec-b595-ad0f256e6e8c tempest-VolumesNegativeTest-26467911 None] Lock "cinder-01f4f517-3a08-4115-97b2-72e1ecff366b-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:34 devstack sudo[111297]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8" returned: 0 in 0.892s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:34 devstack sudo[111298]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0" returned: 0 in 0.883s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:26:34 devstack sudo[111308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 Jun 25 18:26:34 devstack sudo[111308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302846b-7f70-4327-ae56-75919bf4220f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:34 devstack sudo[111310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd Jun 25 18:26:34 devstack sudo[111310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:34 devstack sudo[111308]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0" returned: 0 in 0.867s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:34 devstack sudo[111319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0 Jun 25 18:26:34 devstack sudo[111319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:34 devstack sudo[111310]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" returned: 0 in 0.897s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:34 devstack sudo[111321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 Jun 25 18:26:34 devstack sudo[111321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:35 devstack sudo[111319]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8.1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0" returned: 0 in 0.692s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0" released by "_delete_snapshot" :: held 3.470s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-e614be7c-28af-4b93-a1bd-6777970c90d8" released by "delete_snapshot" :: held 3.492s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:35 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Created reservations ['b47a504a-5db0-4426-8cc0-30babb16560e', '7ca2bc2e-05fc-4da4-a54d-40290979f1f7', 'ca3d39b3-af98-44eb-b81f-59d40a767abd', 'ec041173-2a27-44a2-832a-3e0e0933c5cc'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:35 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Delete snapshot completed successfully. Jun 25 18:26:35 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9b50b971-a2da-4cff-9336-bd9c2a2e32a7 tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-1b14d8f9-cb12-4cf2-aec3-60076a8cdfe0-delete_snapshot" released by "delete_snapshot" :: held 3.668s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:35 devstack sudo[111321]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0" returned: 0 in 0.994s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:35 devstack sudo[111327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0 Jun 25 18:26:35 devstack sudo[111327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "cinder-e614be7c-28af-4b93-a1bd-6777970c90d8-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-e614be7c-28af-4b93-a1bd-6777970c90d8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "cinder-quobyte-e614be7c-28af-4b93-a1bd-6777970c90d8" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-e614be7c-28af-4b93-a1bd-6777970c90d8" acquired by "delete_volume" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42a26d1-ecba-4c58-8587-0b9498be8157]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:36 devstack sudo[111329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 Jun 25 18:26:36 devstack sudo[111329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:36 devstack sudo[111327]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd.54a064d9-08c6-4de4-80c0-6a41f53644c0" returned: 0 in 0.778s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Lock "cinder-quobyte-54a064d9-08c6-4de4-80c0-6a41f53644c0" released by "_delete_snapshot" :: held 3.692s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Lock "cinder-quobyte-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" released by "delete_snapshot" :: held 3.738s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:36 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Created reservations ['1bdd4a0c-3905-45d3-b871-7caf23241014', '4906e00f-1671-43c7-b44f-5dd9adf09d10', 'f6cd73bd-5b5a-492e-adc7-74890d47cb4e', '07ec9655-786d-46e6-bc5d-b906b1d9f32a'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Delete snapshot completed successfully. Jun 25 18:26:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8056de35-5e34-4331-96ac-9a1ec8addee7 tempest-VolumesExtendTest-799608423 None] Lock "cinder-54a064d9-08c6-4de4-80c0-6a41f53644c0-delete_snapshot" released by "delete_snapshot" :: held 4.060s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Acquiring lock "cinder-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Lock "cinder-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Acquiring lock "cinder-quobyte-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Lock "cinder-quobyte-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:37 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17e7273-66be-49d0-8428-a605276b32ad]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:37 devstack sudo[111329]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8" returned: 0 in 0.987s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:37 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8 Jun 25 18:26:37 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:37 devstack sudo[111335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd Jun 25 18:26:37 devstack sudo[111335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:38 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-e614be7c-28af-4b93-a1bd-6777970c90d8" returned: 0 in 0.748s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-e614be7c-28af-4b93-a1bd-6777970c90d8" released by "delete_volume" :: held 1.823s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:38 devstack sudo[111335]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" returned: 0 in 0.865s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=62,cinder:INSERT=26,cinder:UPDATE=62,cinder:DELETE=8 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:26:38 devstack sudo[111343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd Jun 25 18:26:38 devstack sudo[111343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Created reservations ['a5cb674c-5385-4048-971c-4eb6fff18146', '09de7cba-6dca-44f6-9f5e-6e9353a02674', 'eea77308-757e-49c1-a2ed-9c51b201be19', '05932b88-ed54-4617-87e4-06466daae6d0'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:38 devstack sudo[111345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:26:38 devstack sudo[111345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "cinder-51038c01-6e86-445c-8c56-785a43ee915f-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-51038c01-6e86-445c-8c56-785a43ee915f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "cinder-quobyte-51038c01-6e86-445c-8c56-785a43ee915f" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-51038c01-6e86-445c-8c56-785a43ee915f" acquired by "delete_volume" :: waited 0.036s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43a52fa-cf2c-40c8-808b-cee06c6cd1d4]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:39 devstack sudo[111347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f Jun 25 18:26:39 devstack sudo[111347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:39 devstack sudo[111343]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" returned: 0 in 0.852s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Lock "cinder-quobyte-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd" released by "delete_volume" :: held 1.784s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Created reservations ['1ec214fb-61fa-4746-8667-3da03a80741d', '20b31477-4efc-41ba-a386-5ceb5134857b', '80beb40d-3693-4530-ab48-9098d0304100', '6865e6db-67e8-4207-91a5-fe2d510cebda'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:39 devstack sudo[111351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:26:39 devstack sudo[111351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:39 devstack sudo[111345]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.964s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:26:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Deleted volume successfully. Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a026d7b3-aa84-4d82-9ba4-0bfaacffdb6a tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-e614be7c-28af-4b93-a1bd-6777970c90d8-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:39 devstack sudo[111347]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f" returned: 0 in 0.969s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:39 devstack sudo[111356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f Jun 25 18:26:39 devstack sudo[111356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:40 devstack sudo[111351]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.958s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:26:40 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Deleted volume successfully. Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9f6f986a-533e-4ee3-9c47-faf62bafc696 tempest-VolumesExtendTest-799608423 None] Lock "cinder-18dfdfb4-418c-4a14-b08c-aad1e2e6c7dd-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:40 devstack sudo[111359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:26:40 devstack sudo[111359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:40 devstack sudo[111356]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-51038c01-6e86-445c-8c56-785a43ee915f" returned: 0 in 0.936s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-quobyte-51038c01-6e86-445c-8c56-785a43ee915f" released by "delete_volume" :: held 1.968s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:40 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Created reservations ['1bb837a5-f405-45ba-a6b8-bccddd6bf81f', '7973d4e3-86f7-48f5-b4f4-1ed4664948b7', '09b2320b-c951-4711-8332-ba1ee458389e', '442df76c-bf7e-4670-9273-854f34211896'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:41 devstack sudo[111362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:26:41 devstack sudo[111362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:41 devstack sudo[111359]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.837s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:26:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:26:42 devstack sudo[111362]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.099s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:42 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:26:42 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Deleted volume successfully. Jun 25 18:26:42 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fdf4cfe1-1092-418f-803f-7736626d280f tempest-SnapshotDependencyTests-1489603635 None] Lock "cinder-51038c01-6e86-445c-8c56-785a43ee915f-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:52 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=60,cinder:INSERT=20,cinder:UPDATE=72,cinder:DELETE=5 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:26:54 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=25,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:27:36 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:27:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Flow 'volume_create_manager' (c25ec0bc-9692-40bf-9118-ca7a42f2d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:27:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11fbca5-ff0b-4673-b95d-152e5049a1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11fbca5-ff0b-4673-b95d-152e5049a1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2022408951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a26c69-f0f5-4129-8b39-277c9c3141ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c8807cc17a4b82948d35f0d51ffd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:27:37Z,use_quota=True,user_id='75b54430a02142ec810a6fbde34b1598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796104d3-4394-4134-9e98-6ebf4942081b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796104d3-4394-4134-9e98-6ebf4942081b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:36 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d6f293-7e5f-4aaf-931c-83aa1a999d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d6f293-7e5f-4aaf-931c-83aa1a999d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a26c69-f0f5-4129-8b39-277c9c3141ba', 'volume_name': 'volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d76af9a-c4ec-4ed7-81f1-45410c5b469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d76af9a-c4ec-4ed7-81f1-45410c5b469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc93d49-377a-4639-ad64-05f5727d1f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:37 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Volume a4a26c69-f0f5-4129-8b39-277c9c3141ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba', 'volume_size': 1} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2022408951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a26c69-f0f5-4129-8b39-277c9c3141ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c8807cc17a4b82948d35f0d51ffd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:27:37Z,use_quota=True,user_id='75b54430a02142ec810a6fbde34b1598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Creating volume a4a26c69-f0f5-4129-8b39-277c9c3141ba {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:27:37 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:37 devstack sudo[111675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba 1073741824 Jun 25 18:27:37 devstack sudo[111675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:37 devstack sudo[111675]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba 1073741824" returned: 0 in 0.921s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:38 devstack sudo[111681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba Jun 25 18:27:38 devstack sudo[111681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:38 devstack sudo[111681]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba" returned: 0 in 0.724s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:38 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:27:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:27:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc93d49-377a-4639-ad64-05f5727d1f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537afe47-8b0d-407b-8a53-d51fa2871914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:38 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Volume volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba (a4a26c69-f0f5-4129-8b39-277c9c3141ba): created successfully Jun 25 18:27:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537afe47-8b0d-407b-8a53-d51fa2871914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:38 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Flow 'volume_create_manager' (c25ec0bc-9692-40bf-9118-ca7a42f2d458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:27:38 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-14ce2413-d7ed-4003-913b-9947e15db51a tempest-TestMinimumBasicScenario-1538023957 None] Created volume successfully. Jun 25 18:27:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:27:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:27:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:27:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:27:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:27:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:27:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:40 devstack sudo[111687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:27:40 devstack sudo[111687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:41 devstack sudo[111687]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.663s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:27:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:27:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:27:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:27:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-2ec9f769-dff5-44c2-b0dc-7f87f848d72e req-a53989dc-ed2c-420f-ae8e-3bc92225e782 tempest-TestMinimumBasicScenario-1538023957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:27:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-2ec9f769-dff5-44c2-b0dc-7f87f848d72e req-a53989dc-ed2c-420f-ae8e-3bc92225e782 tempest-TestMinimumBasicScenario-1538023957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:27:42 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c62aac0-a25b-49e1-9c90-d69cec5ca5ec]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:27:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-2ec9f769-dff5-44c2-b0dc-7f87f848d72e req-a53989dc-ed2c-420f-ae8e-3bc92225e782 tempest-TestMinimumBasicScenario-1538023957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:42 devstack sudo[111698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba Jun 25 18:27:42 devstack sudo[111698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:43 devstack sudo[111698]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-2ec9f769-dff5-44c2-b0dc-7f87f848d72e req-a53989dc-ed2c-420f-ae8e-3bc92225e782 tempest-TestMinimumBasicScenario-1538023957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba" returned: 0 in 0.783s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-2ec9f769-dff5-44c2-b0dc-7f87f848d72e req-a53989dc-ed2c-420f-ae8e-3bc92225e782 tempest-TestMinimumBasicScenario-1538023957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.802s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:27:43 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-2ec9f769-dff5-44c2-b0dc-7f87f848d72e req-a53989dc-ed2c-420f-ae8e-3bc92225e782 tempest-TestMinimumBasicScenario-1538023957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbb65329-72a6-4f8d-b185-5e3275f80dd5', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:27:43 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-2ec9f769-dff5-44c2-b0dc-7f87f848d72e req-a53989dc-ed2c-420f-ae8e-3bc92225e782 tempest-TestMinimumBasicScenario-1538023957 None] attachment_update completed successfully. Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Flow 'volume_create_manager' (8ecb7a0c-facc-4f61-8803-0c7b3a76d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4de8db-5b6b-4fc2-b35c-ac26cabeb504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4de8db-5b6b-4fc2-b35c-ac26cabeb504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-911067465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010d873d-417b-4acc-8176-ba11dbd12f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17930bd05384dc897c827e6cf7a130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:27:46Z,use_quota=True,user_id='79eb00da553f4a169ba8a2db8addb2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fea71d5-61db-4bff-9a48-7d7bb6e471ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fea71d5-61db-4bff-9a48-7d7bb6e471ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f1bb42-78a2-4694-955c-2db6080bcfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f1bb42-78a2-4694-955c-2db6080bcfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010d873d-417b-4acc-8176-ba11dbd12f21', 'volume_name': 'volume-010d873d-417b-4acc-8176-ba11dbd12f21', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce9690d-ea43-4df7-80d3-6003355d3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce9690d-ea43-4df7-80d3-6003355d3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7257e53-d457-43cf-8577-a19daa84dcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:46 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Volume 010d873d-417b-4acc-8176-ba11dbd12f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010d873d-417b-4acc-8176-ba11dbd12f21', 'volume_size': 1} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-911067465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010d873d-417b-4acc-8176-ba11dbd12f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17930bd05384dc897c827e6cf7a130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:27:46Z,use_quota=True,user_id='79eb00da553f4a169ba8a2db8addb2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Creating volume 010d873d-417b-4acc-8176-ba11dbd12f21 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:27:46 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:27:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:46 devstack sudo[112119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 1073741824 Jun 25 18:27:46 devstack sudo[112119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:47 devstack sudo[112119]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 1073741824" returned: 0 in 0.873s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:47 devstack sudo[112127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 Jun 25 18:27:47 devstack sudo[112127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:47 devstack sudo[112127]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21" returned: 0 in 0.639s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:47 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:27:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:27:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7257e53-d457-43cf-8577-a19daa84dcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010d873d-417b-4acc-8176-ba11dbd12f21', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c14de5-bf39-4cb9-9e9e-bce7bc3919b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:27:47 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Volume volume-010d873d-417b-4acc-8176-ba11dbd12f21 (010d873d-417b-4acc-8176-ba11dbd12f21): created successfully Jun 25 18:27:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c14de5-bf39-4cb9-9e9e-bce7bc3919b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:27:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Flow 'volume_create_manager' (8ecb7a0c-facc-4f61-8803-0c7b3a76d019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:27:47 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-cce62ae5-bea4-46d2-a977-6ac25e739aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Created volume successfully. Jun 25 18:27:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-2d2806cc-4238-4552-965a-7a5477d0cc10 req-28eac4fc-aa83-4976-9ce0-c18349cb85db tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:27:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-2d2806cc-4238-4552-965a-7a5477d0cc10 req-28eac4fc-aa83-4976-9ce0-c18349cb85db tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:27:51 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c478c44-4736-4688-8cd9-26aebb517892]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:27:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-2d2806cc-4238-4552-965a-7a5477d0cc10 req-28eac4fc-aa83-4976-9ce0-c18349cb85db tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:51 devstack sudo[112144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 Jun 25 18:27:51 devstack sudo[112144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:52 devstack sudo[112144]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-2d2806cc-4238-4552-965a-7a5477d0cc10 req-28eac4fc-aa83-4976-9ce0-c18349cb85db tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21" returned: 0 in 0.899s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-2d2806cc-4238-4552-965a-7a5477d0cc10 req-28eac4fc-aa83-4976-9ce0-c18349cb85db tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.923s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:27:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-2d2806cc-4238-4552-965a-7a5477d0cc10 req-28eac4fc-aa83-4976-9ce0-c18349cb85db tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-010d873d-417b-4acc-8176-ba11dbd12f21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50a3f991-408e-41f1-9699-89e17f4e27d7', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:27:52 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-2d2806cc-4238-4552-965a-7a5477d0cc10 req-28eac4fc-aa83-4976-9ce0-c18349cb85db tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] attachment_update completed successfully. Jun 25 18:27:59 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-9dc72684-0a3e-4274-be1b-572546663ded req-d1cfa428-4b31-4efa-ab7d-426ed759b839 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Terminate volume connection completed successfully. Jun 25 18:27:59 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-9dc72684-0a3e-4274-be1b-572546663ded req-d1cfa428-4b31-4efa-ab7d-426ed759b839 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Deleting attachment 50a3f991-408e-41f1-9699-89e17f4e27d7. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:28:01 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Acquiring lock "cinder-010d873d-417b-4acc-8176-ba11dbd12f21-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:01 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "cinder-010d873d-417b-4acc-8176-ba11dbd12f21-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:01 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Acquiring lock "cinder-quobyte-010d873d-417b-4acc-8176-ba11dbd12f21" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:01 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "cinder-quobyte-010d873d-417b-4acc-8176-ba11dbd12f21" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:01 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3744810-9bbd-41f4-b090-9600dde4c880]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:01 devstack sudo[112214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 Jun 25 18:28:01 devstack sudo[112214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:02 devstack sudo[112214]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21" returned: 0 in 0.794s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:02 devstack sudo[112219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21 Jun 25 18:28:02 devstack sudo[112219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:03 devstack sudo[112219]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-010d873d-417b-4acc-8176-ba11dbd12f21" returned: 0 in 0.685s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "cinder-quobyte-010d873d-417b-4acc-8176-ba11dbd12f21" released by "delete_volume" :: held 1.525s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:03 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Created reservations ['ecd714c8-6000-4971-9071-917b7a45aa24', '2ebd1667-0842-423d-86c6-9a09aa17e899', 'c4f672e2-88f7-49db-b1c5-cfa16a0d2baf', 'bdf7516e-6a16-4d8e-8460-4a44f1c7599b'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:03 devstack sudo[112223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:28:03 devstack sudo[112223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:04 devstack sudo[112223]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.156s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:04 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Deleted volume successfully. Jun 25 18:28:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-155f44fb-fb72-4091-b477-ace540076578 tempest-TestServerVolumeAttachScenarioOldVersion-1667210098 None] Lock "cinder-010d873d-417b-4acc-8176-ba11dbd12f21-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:13 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=19,cinder:UPDATE=19,cinder:INSERT=3 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:28:14 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=15,cinder:SELECT=23,cinder:INSERT=3,cinder:DELETE=3 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:28:32 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-b10e6675-5589-4ed4-8d34-8c860f67ff9c req-ac502673-f480-4df8-bf05-aecffedb4dbf tempest-TestMinimumBasicScenario-1538023957 None] Terminate volume connection completed successfully. Jun 25 18:28:32 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-b10e6675-5589-4ed4-8d34-8c860f67ff9c req-ac502673-f480-4df8-bf05-aecffedb4dbf tempest-TestMinimumBasicScenario-1538023957 None] Deleting attachment dbb65329-72a6-4f8d-b185-5e3275f80dd5. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:28:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Acquiring lock "cinder-a4a26c69-f0f5-4129-8b39-277c9c3141ba-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Lock "cinder-a4a26c69-f0f5-4129-8b39-277c9c3141ba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Acquiring lock "cinder-quobyte-a4a26c69-f0f5-4129-8b39-277c9c3141ba" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Lock "cinder-quobyte-a4a26c69-f0f5-4129-8b39-277c9c3141ba" acquired by "delete_volume" :: waited 0.014s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:34 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4ef3b9-f826-4ba5-ae14-0c0833a45ad7]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:34 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:34 devstack sudo[112565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba Jun 25 18:28:34 devstack sudo[112565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:35 devstack sudo[112565]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba" returned: 0 in 0.870s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:35 devstack sudo[112570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba Jun 25 18:28:35 devstack sudo[112570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:36 devstack sudo[112570]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a4a26c69-f0f5-4129-8b39-277c9c3141ba" returned: 0 in 0.764s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:36 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Lock "cinder-quobyte-a4a26c69-f0f5-4129-8b39-277c9c3141ba" released by "delete_volume" :: held 1.718s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:36 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Created reservations ['279c612c-e754-4be1-aad6-d2d750779dd5', '4047bf51-b992-4ebe-9f57-69b98a97440f', '2e79d748-e8a6-4cd3-9204-6e782ae6a83a', 'b32f754d-b31b-44e3-b296-fafe950821c3'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:36 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:36 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:36 devstack sudo[112573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:28:36 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:37 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.853s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:37 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:37 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Deleted volume successfully. Jun 25 18:28:37 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1d8ee33a-7af6-47e3-9456-13e232a9fda6 tempest-TestMinimumBasicScenario-1538023957 None] Lock "cinder-a4a26c69-f0f5-4129-8b39-277c9c3141ba-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:28:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:40 devstack sudo[112621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:28:40 devstack sudo[112621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:41 devstack sudo[112621]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.916s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:28:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:28:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:28:54 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:28:54 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Flow 'volume_create_manager' (2fb0e192-3981-44ab-8eca-3e422f930a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6e2d38-aff7-4c63-90e7-fbb1f70384b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6e2d38-aff7-4c63-90e7-fbb1f70384b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-581647447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d427bc-800c-4c48-901d-5296a5c68981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6563e52ccd64817b81378502d2b48e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:55Z,use_quota=True,user_id='085effe03e664a41af7acf81fe64fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64691835-7bea-4061-a3b6-d970e413607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64691835-7bea-4061-a3b6-d970e413607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c160e68-f9f9-4517-871a-356c9af68043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c160e68-f9f9-4517-871a-356c9af68043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d427bc-800c-4c48-901d-5296a5c68981', 'volume_name': 'volume-25d427bc-800c-4c48-901d-5296a5c68981', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6198df0-7b26-47e1-9a86-3119249a7ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6198df0-7b26-47e1-9a86-3119249a7ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93605d9f-469d-4bda-b3ac-6ff64fce2ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Volume 25d427bc-800c-4c48-901d-5296a5c68981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d427bc-800c-4c48-901d-5296a5c68981', 'volume_size': 1} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-581647447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d427bc-800c-4c48-901d-5296a5c68981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6563e52ccd64817b81378502d2b48e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:55Z,use_quota=True,user_id='085effe03e664a41af7acf81fe64fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Creating volume 25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:55 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:28:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:55 devstack sudo[112667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 1073741824 Jun 25 18:28:55 devstack sudo[112667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:56 devstack sudo[112667]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 1073741824" returned: 0 in 1.102s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:56 devstack sudo[112677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 Jun 25 18:28:56 devstack sudo[112677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:57 devstack sudo[112677]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981" returned: 0 in 0.712s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93605d9f-469d-4bda-b3ac-6ff64fce2ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d427bc-800c-4c48-901d-5296a5c68981', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e129346-b0e6-4d6f-8c67-0fad82aa29c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:57 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Volume volume-25d427bc-800c-4c48-901d-5296a5c68981 (25d427bc-800c-4c48-901d-5296a5c68981): created successfully Jun 25 18:28:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e129346-b0e6-4d6f-8c67-0fad82aa29c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Flow 'volume_create_manager' (2fb0e192-3981-44ab-8eca-3e422f930a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:57 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0826b640-cd0d-479e-8d13-0c94bb6adc4c tempest-TestStampPattern-1930525218 None] Created volume successfully. Jun 25 18:29:07 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:29:07 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:29:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-6c1c4a89-cc3e-4f68-bc05-464971868b8c req-aa18234b-68c2-41b7-b76c-b08c1b06c24a tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-6c1c4a89-cc3e-4f68-bc05-464971868b8c req-aa18234b-68c2-41b7-b76c-b08c1b06c24a tempest-TestStampPattern-1930525218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:38 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[427c3dfd-e44b-4aff-a783-f4e417c04111]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-6c1c4a89-cc3e-4f68-bc05-464971868b8c req-aa18234b-68c2-41b7-b76c-b08c1b06c24a tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:39 devstack sudo[112831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 Jun 25 18:29:39 devstack sudo[112831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:39 devstack sudo[112831]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-6c1c4a89-cc3e-4f68-bc05-464971868b8c req-aa18234b-68c2-41b7-b76c-b08c1b06c24a tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981" returned: 0 in 0.884s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-6c1c4a89-cc3e-4f68-bc05-464971868b8c req-aa18234b-68c2-41b7-b76c-b08c1b06c24a tempest-TestStampPattern-1930525218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.904s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:39 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-6c1c4a89-cc3e-4f68-bc05-464971868b8c req-aa18234b-68c2-41b7-b76c-b08c1b06c24a tempest-TestStampPattern-1930525218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-25d427bc-800c-4c48-901d-5296a5c68981', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd61858ea-49e5-472e-b9bf-2598f16852e9', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:29:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-6c1c4a89-cc3e-4f68-bc05-464971868b8c req-aa18234b-68c2-41b7-b76c-b08c1b06c24a tempest-TestStampPattern-1930525218 None] attachment_update completed successfully. Jun 25 18:29:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:29:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:40 devstack sudo[112882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:29:40 devstack sudo[112882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:41 devstack sudo[112882]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.772s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:29:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:29:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:29:49 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-f31f0d4c-e530-49fd-aff7-ae5ca5dcc4a0 req-7ce2732c-8a33-4e41-a65d-a13d984bc23d tempest-TestStampPattern-1930525218 None] Terminate volume connection completed successfully. Jun 25 18:29:49 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-f31f0d4c-e530-49fd-aff7-ae5ca5dcc4a0 req-7ce2732c-8a33-4e41-a65d-a13d984bc23d tempest-TestStampPattern-1930525218 None] Deleting attachment d61858ea-49e5-472e-b9bf-2598f16852e9. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:29:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Creating offline snapshot 3e44a144-25b5-4239-a083-43e193aa56c5 of volume 25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:29:51 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a06400f-8287-42cb-8520-740c51828549]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:51 devstack sudo[113279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 Jun 25 18:29:51 devstack sudo[113279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:52 devstack sudo[113279]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981" returned: 0 in 0.833s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:52 devstack sudo[113284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 1G Jun 25 18:29:52 devstack sudo[113284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:53 devstack sudo[113284]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 1G" returned: 0 in 0.875s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d427bc-800c-4c48-901d-5296a5c68981 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:53 devstack sudo[113325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d427bc-800c-4c48-901d-5296a5c68981 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 Jun 25 18:29:53 devstack sudo[113325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:53 devstack sudo[113325]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d427bc-800c-4c48-901d-5296a5c68981 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5" returned: 0 in 0.780s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:53 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 is being set with open permissions: ugo+rw Jun 25 18:29:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:53 devstack sudo[113332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 Jun 25 18:29:53 devstack sudo[113332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:54 devstack sudo[113332]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5" returned: 0 in 0.742s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:54 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.info Jun 25 18:29:54 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:55 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.info" returned: 0 in 0.703s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:55 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.info is being set with open permissions: ugo+rw Jun 25 18:29:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:55 devstack sudo[113338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.info Jun 25 18:29:55 devstack sudo[113338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:56 devstack sudo[113338]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.info" returned: 0 in 0.627s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.668s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:56 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-581c9c9f-b3e4-4a2c-80f1-ef7b70f2fac4 tempest-TestStampPattern-1930525218 None] Create snapshot completed successfully Jun 25 18:30:06 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:30:06 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Flow 'volume_create_manager' (70be47eb-fea8-4cbe-a552-368c8bd497f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecd9131-ad1f-476c-a7ea-798039d21bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecd9131-ad1f-476c-a7ea-798039d21bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1624261664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e112ac-f06a-4c76-bbee-39fbad19a26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6563e52ccd64817b81378502d2b48e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e44a144-25b5-4239-a083-43e193aa56c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:30:08Z,use_quota=True,user_id='085effe03e664a41af7acf81fe64fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63c401a-5d34-4dbe-9762-824c8df335df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63c401a-5d34-4dbe-9762-824c8df335df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c108cf-0a42-416c-ab0c-8fddd05e55ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c108cf-0a42-416c-ab0c-8fddd05e55ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64e112ac-f06a-4c76-bbee-39fbad19a26f', 'volume_name': 'volume-64e112ac-f06a-4c76-bbee-39fbad19a26f', 'volume_size': 1, 'snapshot_id': '3e44a144-25b5-4239-a083-43e193aa56c5'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a642b6a-8624-4eb0-8a3e-512c5269d5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a642b6a-8624-4eb0-8a3e-512c5269d5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181d825c-ba48-4fad-b383-67103f84f8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:30:07 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Volume 64e112ac-f06a-4c76-bbee-39fbad19a26f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64e112ac-f06a-4c76-bbee-39fbad19a26f', 'volume_size': 1, 'snapshot_id': '3e44a144-25b5-4239-a083-43e193aa56c5'} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Acquiring lock "cinder-quobyte-3e44a144-25b5-4239-a083-43e193aa56c5-64e112ac-f06a-4c76-bbee-39fbad19a26f" by "_create_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-3e44a144-25b5-4239-a083-43e193aa56c5-64e112ac-f06a-4c76-bbee-39fbad19a26f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Creating volume 64e112ac-f06a-4c76-bbee-39fbad19a26f from snapshot 3e44a144-25b5-4239-a083-43e193aa56c5 {{(pid=93767) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Acquiring lock "cinder-quobyte-64e112ac-f06a-4c76-bbee-39fbad19a26f" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-64e112ac-f06a-4c76-bbee-39fbad19a26f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] snapshot: 3e44a144-25b5-4239-a083-43e193aa56c5, volume: 64e112ac-f06a-4c76-bbee-39fbad19a26f, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[12103e6d-f5aa-4645-a4d2-cec2d120d245]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:30:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:30:08 devstack sudo[113391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 Jun 25 18:30:08 devstack sudo[113391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:30:08 devstack sudo[113391]: pam_unix(sudo:session): session closed for user root Jun 25 18:30:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5" returned: 0 in 0.913s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:30:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25d427bc-800c-4c48-901d-5296a5c68981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:30:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:30:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:30:08 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f69284-e28b-4af1-8bca-480f534b80e7]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:30:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:30:08 devstack sudo[113400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 Jun 25 18:30:08 devstack sudo[113400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:30:09 devstack sudo[113400]: pam_unix(sudo:session): session closed for user root Jun 25 18:30:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981" returned: 0 in 0.879s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:30:09 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:30:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:30:09 devstack sudo[113405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f Jun 25 18:30:09 devstack sudo[113405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:30:15 devstack sudo[113405]: pam_unix(sudo:session): session closed for user root Jun 25 18:30:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f" returned: 0 in 5.542s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:30:15 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e63139c-e5f6-466b-8db8-4d6d98aaaf96]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:30:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:30:15 devstack sudo[113426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 Jun 25 18:30:15 devstack sudo[113426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:30:16 devstack sudo[113426]: pam_unix(sudo:session): session closed for user root Jun 25 18:30:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981" returned: 0 in 1.143s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:30:16 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:30:16 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Converted 1024.00 MB image at 184.74 MB/s Jun 25 18:30:16 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f is being set with open permissions: ugo+rw Jun 25 18:30:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:30:16 devstack sudo[113431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f Jun 25 18:30:16 devstack sudo[113431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:30:17 devstack sudo[113431]: pam_unix(sudo:session): session closed for user root Jun 25 18:30:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f" returned: 0 in 0.847s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:30:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-64e112ac-f06a-4c76-bbee-39fbad19a26f" released by "_copy_volume_from_snapshot" :: held 9.455s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:30:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-3e44a144-25b5-4239-a083-43e193aa56c5-64e112ac-f06a-4c76-bbee-39fbad19a26f" released by "_create_volume_from_snapshot" :: held 9.489s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:30:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.506s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:30:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181d825c-ba48-4fad-b383-67103f84f8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e112ac-f06a-4c76-bbee-39fbad19a26f', 'volume_size': 1, 'snapshot_id': '3e44a144-25b5-4239-a083-43e193aa56c5'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:30:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9115682f-f905-4312-b37c-bc1e9bf6fd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:30:17 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Volume volume-64e112ac-f06a-4c76-bbee-39fbad19a26f (64e112ac-f06a-4c76-bbee-39fbad19a26f): created successfully Jun 25 18:30:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9115682f-f905-4312-b37c-bc1e9bf6fd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:30:17 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Flow 'volume_create_manager' (70be47eb-fea8-4cbe-a552-368c8bd497f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:30:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a3475257-96f9-44ac-ba3c-c4e2c21748d1 tempest-TestStampPattern-1930525218 None] Created volume successfully. Jun 25 18:30:27 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:30:27 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:30:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:30:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:30:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:30:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:30:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:30:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:30:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:30:40 devstack sudo[113537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:30:40 devstack sudo[113537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:30:41 devstack sudo[113537]: pam_unix(sudo:session): session closed for user root Jun 25 18:30:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.673s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:30:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:30:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:30:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:30:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:30:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-c92ee9a1-5f67-4bf1-9dd9-a11a69b60326 req-43df7e92-f77f-45a9-83a1-35cf2f5bc70a tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:30:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-c92ee9a1-5f67-4bf1-9dd9-a11a69b60326 req-43df7e92-f77f-45a9-83a1-35cf2f5bc70a tempest-TestStampPattern-1930525218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:30:54 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a8925c-ad3a-436b-8b7a-1db3ab88fdeb]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:30:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c92ee9a1-5f67-4bf1-9dd9-a11a69b60326 req-43df7e92-f77f-45a9-83a1-35cf2f5bc70a tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:30:54 devstack sudo[113593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f Jun 25 18:30:54 devstack sudo[113593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:30:54 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:30:54 devstack sudo[113593]: pam_unix(sudo:session): session closed for user root Jun 25 18:30:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [req-c92ee9a1-5f67-4bf1-9dd9-a11a69b60326 req-43df7e92-f77f-45a9-83a1-35cf2f5bc70a tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f" returned: 0 in 0.808s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:30:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [req-c92ee9a1-5f67-4bf1-9dd9-a11a69b60326 req-43df7e92-f77f-45a9-83a1-35cf2f5bc70a tempest-TestStampPattern-1930525218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:30:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-c92ee9a1-5f67-4bf1-9dd9-a11a69b60326 req-43df7e92-f77f-45a9-83a1-35cf2f5bc70a tempest-TestStampPattern-1930525218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca', 'name': 'volume-64e112ac-f06a-4c76-bbee-39fbad19a26f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24371735-a91c-41cf-9310-f2560d51ce0e', 'enforce_multipath': True} {{(pid=93767) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5556}} Jun 25 18:30:54 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-c92ee9a1-5f67-4bf1-9dd9-a11a69b60326 req-43df7e92-f77f-45a9-83a1-35cf2f5bc70a tempest-TestStampPattern-1930525218 None] attachment_update completed successfully. Jun 25 18:31:01 devstack cinder-volume[93767]: INFO cinder.volume.manager [req-193e1597-a037-42a0-82e8-e8b2476afbcf req-7cc01d83-9cc2-477b-9f4b-25a4fb424d5b tempest-TestStampPattern-1930525218 None] Terminate volume connection completed successfully. Jun 25 18:31:01 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [req-193e1597-a037-42a0-82e8-e8b2476afbcf req-7cc01d83-9cc2-477b-9f4b-25a4fb424d5b tempest-TestStampPattern-1930525218 None] Deleting attachment 24371735-a91c-41cf-9310-f2560d51ce0e. {{(pid=93767) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5687}} Jun 25 18:31:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Acquiring lock "cinder-64e112ac-f06a-4c76-bbee-39fbad19a26f-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Lock "cinder-64e112ac-f06a-4c76-bbee-39fbad19a26f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Acquiring lock "cinder-quobyte-64e112ac-f06a-4c76-bbee-39fbad19a26f" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-64e112ac-f06a-4c76-bbee-39fbad19a26f" acquired by "delete_volume" :: waited 0.014s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:11 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[8108c8d9-5676-4db6-8446-6bf5a72653f4]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:31:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:11 devstack sudo[114087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f Jun 25 18:31:11 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:12 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f" returned: 0 in 0.814s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:12 devstack sudo[114092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f Jun 25 18:31:12 devstack sudo[114092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:12 devstack sudo[114092]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-64e112ac-f06a-4c76-bbee-39fbad19a26f" returned: 0 in 0.745s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-64e112ac-f06a-4c76-bbee-39fbad19a26f" released by "delete_volume" :: held 1.614s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:31:12 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Created reservations ['e376778e-bcef-47b5-b11c-488c60b3dc33', '6a540bd2-b97c-4c3e-844e-c1bb0bc18b85', '8945c015-527b-42cb-a869-82a6a04127b3', '5363d346-b184-4862-a794-1ce606fc67fa'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:31:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:31:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:31:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:31:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:13 devstack sudo[114096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:31:13 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:13 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.731s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:31:13 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Deleted volume successfully. Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f2aaa83a-378f-4021-9ae1-b3675c7cc515 tempest-TestStampPattern-1930525218 None] Lock "cinder-64e112ac-f06a-4c76-bbee-39fbad19a26f-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Acquiring lock "cinder-3e44a144-25b5-4239-a083-43e193aa56c5-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Lock "cinder-3e44a144-25b5-4239-a083-43e193aa56c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Acquiring lock "cinder-quobyte-25d427bc-800c-4c48-901d-5296a5c68981" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-25d427bc-800c-4c48-901d-5296a5c68981" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Acquiring lock "cinder-quobyte-3e44a144-25b5-4239-a083-43e193aa56c5" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-3e44a144-25b5-4239-a083-43e193aa56c5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Deleting offline snapshot 3e44a144-25b5-4239-a083-43e193aa56c5 of volume 25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] snapshot_file for this snap is: volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a081f-fa1c-4f37-944e-bcf16923cb92]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:31:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:13 devstack sudo[114105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 Jun 25 18:31:13 devstack sudo[114105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:14 devstack sudo[114105]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5" returned: 0 in 0.837s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25d427bc-800c-4c48-901d-5296a5c68981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:31:14 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d5c9d9-0d23-4314-9542-bc705923ba77]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:31:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:14 devstack sudo[114110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 Jun 25 18:31:14 devstack sudo[114110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:15 devstack sudo[114110]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981" returned: 0 in 0.776s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:15 devstack sudo[114115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 Jun 25 18:31:15 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:16 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5" returned: 0 in 0.768s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:16 devstack sudo[114120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5 Jun 25 18:31:16 devstack sudo[114120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:16 devstack sudo[114120]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981.3e44a144-25b5-4239-a083-43e193aa56c5" returned: 0 in 0.673s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-3e44a144-25b5-4239-a083-43e193aa56c5" released by "_delete_snapshot" :: held 3.158s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:31:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-25d427bc-800c-4c48-901d-5296a5c68981" released by "delete_snapshot" :: held 3.180s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:31:17 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Created reservations ['31373b6c-0732-4555-aa4c-fbe8db7cdad5', '4f44feeb-0b75-49bc-a989-a32229747f16', 'c31b34c0-f298-4de3-81d8-aa34a7d21c79', 'ed4b5372-bc74-4b87-8adb-5d1a08183b9f'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:31:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Delete snapshot completed successfully. Jun 25 18:31:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e07f1173-80b7-46cf-9688-be0773db6df1 tempest-TestStampPattern-1930525218 None] Lock "cinder-3e44a144-25b5-4239-a083-43e193aa56c5-delete_snapshot" released by "delete_snapshot" :: held 3.475s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:31:27 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:31:27 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=22,cinder:UPDATE=16,cinder:INSERT=5 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:31:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Acquiring lock "cinder-25d427bc-800c-4c48-901d-5296a5c68981-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Lock "cinder-25d427bc-800c-4c48-901d-5296a5c68981-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Acquiring lock "cinder-quobyte-25d427bc-800c-4c48-901d-5296a5c68981" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-25d427bc-800c-4c48-901d-5296a5c68981" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9d374c-9a16-4eaf-9c01-a7087fcae9f1]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:31:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:30 devstack sudo[114178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 Jun 25 18:31:30 devstack sudo[114178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:30 devstack sudo[114178]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981" returned: 0 in 0.888s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:30 devstack sudo[114183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981 Jun 25 18:31:30 devstack sudo[114183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:31 devstack sudo[114183]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-25d427bc-800c-4c48-901d-5296a5c68981" returned: 0 in 0.741s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Lock "cinder-quobyte-25d427bc-800c-4c48-901d-5296a5c68981" released by "delete_volume" :: held 1.698s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:31:31 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Created reservations ['0a06978f-3f37-46a8-b553-567123152193', '2d3f5a08-e7ad-4bab-aace-63238b032a03', '4dc1554f-76d5-4637-a343-7d3df6a245f1', '1e634c1e-0c0d-4803-b814-07f9e84f529a'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:31:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:31:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:31:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:31:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:31:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:31:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:31 devstack sudo[114186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:31:31 devstack sudo[114186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:32 devstack sudo[114186]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.762s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:32 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:31:32 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Deleted volume successfully. Jun 25 18:31:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-563eccd9-5c61-4bb0-9f75-103c1df3381d tempest-TestStampPattern-1930525218 None] Lock "cinder-25d427bc-800c-4c48-901d-5296a5c68981-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:31:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:31:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:31:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:31:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:31:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:31:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:31:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:40 devstack sudo[114194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:31:40 devstack sudo[114194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:41 devstack sudo[114194]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.705s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:31:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:31:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:31:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:31:41 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Flow 'volume_create_manager' (d6267516-72a6-48a4-8458-ea8d524cbb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31397dd-8e95-40e4-8234-b3773126a1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31397dd-8e95-40e4-8234-b3773126a1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-834478278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32539cd9-45e3-4259-ae64-f8dba89b158f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191d2d3b5a6e477c9a06e03374ed0e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:31:43Z,use_quota=True,user_id='b43167aba1034dc7a5af29b6bf5bb36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d411d1d-74f2-404d-ab2d-975642c4e8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d411d1d-74f2-404d-ab2d-975642c4e8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c51870-7d2f-4d43-8f0d-d29d3dac8dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c51870-7d2f-4d43-8f0d-d29d3dac8dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32539cd9-45e3-4259-ae64-f8dba89b158f', 'volume_name': 'volume-32539cd9-45e3-4259-ae64-f8dba89b158f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74515035-0c5f-4098-a4a7-a11c2dd77f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74515035-0c5f-4098-a4a7-a11c2dd77f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4da74a-41b2-4639-a32e-f48e8bc3a024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:42 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Volume 32539cd9-45e3-4259-ae64-f8dba89b158f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32539cd9-45e3-4259-ae64-f8dba89b158f', 'volume_size': 1} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-834478278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32539cd9-45e3-4259-ae64-f8dba89b158f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191d2d3b5a6e477c9a06e03374ed0e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:31:43Z,use_quota=True,user_id='b43167aba1034dc7a5af29b6bf5bb36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Creating volume 32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:31:42 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:31:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:42 devstack sudo[114198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f 1073741824 Jun 25 18:31:42 devstack sudo[114198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:43 devstack sudo[114198]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f 1073741824" returned: 0 in 0.841s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:43 devstack sudo[114203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f Jun 25 18:31:43 devstack sudo[114203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:44 devstack sudo[114203]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f" returned: 0 in 0.633s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:44 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:31:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:31:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4da74a-41b2-4639-a32e-f48e8bc3a024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32539cd9-45e3-4259-ae64-f8dba89b158f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08c5104-9647-4afe-b0c4-8b86c8708fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:44 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Volume volume-32539cd9-45e3-4259-ae64-f8dba89b158f (32539cd9-45e3-4259-ae64-f8dba89b158f): created successfully Jun 25 18:31:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08c5104-9647-4afe-b0c4-8b86c8708fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:44 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Flow 'volume_create_manager' (d6267516-72a6-48a4-8458-ea8d524cbb41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:31:44 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0459d599-0ee0-4ce6-bd32-798c16b9411f tempest-VolumeDependencyTests-819691838 None] Created volume successfully. Jun 25 18:31:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:31:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:31:45 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Creating offline snapshot e2916920-5d54-4ce1-888f-2b9db31a709d of volume 32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:31:45 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[faed521e-5b39-4908-8352-19a067600d53]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:31:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:45 devstack sudo[114206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f Jun 25 18:31:45 devstack sudo[114206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:45 devstack sudo[114206]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f" returned: 0 in 0.721s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:45 devstack sudo[114211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d 1G Jun 25 18:31:45 devstack sudo[114211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:46 devstack sudo[114211]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d 1G" returned: 0 in 0.761s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32539cd9-45e3-4259-ae64-f8dba89b158f -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:46 devstack sudo[114217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32539cd9-45e3-4259-ae64-f8dba89b158f -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d Jun 25 18:31:46 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:47 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32539cd9-45e3-4259-ae64-f8dba89b158f -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d" returned: 0 in 0.658s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:47 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d is being set with open permissions: ugo+rw Jun 25 18:31:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:47 devstack sudo[114222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d Jun 25 18:31:47 devstack sudo[114222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:47 devstack sudo[114222]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d" returned: 0 in 0.617s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:47 devstack sudo[114225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.info Jun 25 18:31:47 devstack sudo[114225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:48 devstack sudo[114225]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.info" returned: 0 in 0.615s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:48 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.info is being set with open permissions: ugo+rw Jun 25 18:31:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:48 devstack sudo[114228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.info Jun 25 18:31:48 devstack sudo[114228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:49 devstack sudo[114228]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.info" returned: 0 in 0.622s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.079s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:31:49 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6559af5f-6481-43c7-9f82-320537d1ccc7 tempest-VolumeDependencyTests-819691838 None] Create snapshot completed successfully Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Flow 'volume_create_manager' (8e5d254b-eb9e-4014-8781-f7fe99684eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad93c3d4-ace1-4e4e-ad27-13c74064dab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad93c3d4-ace1-4e4e-ad27-13c74064dab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1301561939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73eefbf6-b929-4c34-b73c-9947ab2a2906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191d2d3b5a6e477c9a06e03374ed0e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e2916920-5d54-4ce1-888f-2b9db31a709d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:31:51Z,use_quota=True,user_id='b43167aba1034dc7a5af29b6bf5bb36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0978d95b-91d9-47c6-92db-ad3d4cc14fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0978d95b-91d9-47c6-92db-ad3d4cc14fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368ef3e7-d1f9-40c5-8e20-3b9d292f5a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368ef3e7-d1f9-40c5-8e20-3b9d292f5a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73eefbf6-b929-4c34-b73c-9947ab2a2906', 'volume_name': 'volume-73eefbf6-b929-4c34-b73c-9947ab2a2906', 'volume_size': 1, 'snapshot_id': 'e2916920-5d54-4ce1-888f-2b9db31a709d'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3602746e-a26c-4563-bdf0-fa68f9755638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3602746e-a26c-4563-bdf0-fa68f9755638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0a3d58-4381-4898-ac85-49a08833c1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:50 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Volume 73eefbf6-b929-4c34-b73c-9947ab2a2906: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73eefbf6-b929-4c34-b73c-9947ab2a2906', 'volume_size': 1, 'snapshot_id': 'e2916920-5d54-4ce1-888f-2b9db31a709d'} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "cinder-quobyte-e2916920-5d54-4ce1-888f-2b9db31a709d-73eefbf6-b929-4c34-b73c-9947ab2a2906" by "_create_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-e2916920-5d54-4ce1-888f-2b9db31a709d-73eefbf6-b929-4c34-b73c-9947ab2a2906" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Creating volume 73eefbf6-b929-4c34-b73c-9947ab2a2906 from snapshot e2916920-5d54-4ce1-888f-2b9db31a709d {{(pid=93767) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "cinder-quobyte-73eefbf6-b929-4c34-b73c-9947ab2a2906" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-73eefbf6-b929-4c34-b73c-9947ab2a2906" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] snapshot: e2916920-5d54-4ce1-888f-2b9db31a709d, volume: 73eefbf6-b929-4c34-b73c-9947ab2a2906, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[91502263-fabb-4537-8852-c70eace6cfd1]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:31:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:51 devstack sudo[114231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d Jun 25 18:31:51 devstack sudo[114231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:51 devstack sudo[114231]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d" returned: 0 in 0.746s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32539cd9-45e3-4259-ae64-f8dba89b158f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:31:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:31:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:31:51 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb7937-dc60-4cc5-930a-6037516a0cb9]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:31:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:51 devstack sudo[114236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f Jun 25 18:31:51 devstack sudo[114236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:52 devstack sudo[114236]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f" returned: 0 in 0.740s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:52 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:31:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:52 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 Jun 25 18:31:52 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:56 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906" returned: 0 in 4.384s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:56 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81c8934-7234-478a-a10a-e000f3c1f03d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:31:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:56 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f Jun 25 18:31:56 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:57 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f" returned: 0 in 0.897s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:57 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:31:57 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Converted 1024.00 MB image at 233.52 MB/s Jun 25 18:31:57 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 is being set with open permissions: ugo+rw Jun 25 18:31:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:57 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 Jun 25 18:31:57 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:31:58 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Jun 25 18:31:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906" returned: 0 in 0.658s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:31:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-73eefbf6-b929-4c34-b73c-9947ab2a2906" released by "_copy_volume_from_snapshot" :: held 7.512s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:31:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-e2916920-5d54-4ce1-888f-2b9db31a709d-73eefbf6-b929-4c34-b73c-9947ab2a2906" released by "_create_volume_from_snapshot" :: held 7.540s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:31:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.555s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:31:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0a3d58-4381-4898-ac85-49a08833c1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73eefbf6-b929-4c34-b73c-9947ab2a2906', 'volume_size': 1, 'snapshot_id': 'e2916920-5d54-4ce1-888f-2b9db31a709d'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa88c8ca-5878-4696-ab48-ccafa699099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:31:58 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Volume volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 (73eefbf6-b929-4c34-b73c-9947ab2a2906): created successfully Jun 25 18:31:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa88c8ca-5878-4696-ab48-ccafa699099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:31:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Flow 'volume_create_manager' (8e5d254b-eb9e-4014-8781-f7fe99684eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:31:58 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-dbcc1c4e-c09a-4f5a-adcb-2222abcda964 tempest-VolumeDependencyTests-819691838 None] Created volume successfully. Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "cinder-e2916920-5d54-4ce1-888f-2b9db31a709d-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-e2916920-5d54-4ce1-888f-2b9db31a709d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "cinder-quobyte-32539cd9-45e3-4259-ae64-f8dba89b158f" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-32539cd9-45e3-4259-ae64-f8dba89b158f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "cinder-quobyte-e2916920-5d54-4ce1-888f-2b9db31a709d" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-e2916920-5d54-4ce1-888f-2b9db31a709d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Deleting offline snapshot e2916920-5d54-4ce1-888f-2b9db31a709d of volume 32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] snapshot_file for this snap is: volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea6cf1c-ea1d-4a35-8e91-1d796b7874b2]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:31:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:31:59 devstack sudo[114301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d Jun 25 18:31:59 devstack sudo[114301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:00 devstack sudo[114301]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d" returned: 0 in 0.758s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32539cd9-45e3-4259-ae64-f8dba89b158f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:32:00 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[17914006-3264-4b13-a546-b75d4577e2a8]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:00 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f Jun 25 18:32:00 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:01 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f" returned: 0 in 0.772s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:01 devstack sudo[114311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d Jun 25 18:32:01 devstack sudo[114311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:01 devstack sudo[114311]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d" returned: 0 in 0.774s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:02 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d Jun 25 18:32:02 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:02 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f.e2916920-5d54-4ce1-888f-2b9db31a709d" returned: 0 in 0.636s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-e2916920-5d54-4ce1-888f-2b9db31a709d" released by "_delete_snapshot" :: held 3.037s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-32539cd9-45e3-4259-ae64-f8dba89b158f" released by "delete_snapshot" :: held 3.062s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:02 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Created reservations ['0d8cf21b-d8db-49c2-ba8c-cdfa23c157bc', 'c064e652-1c7e-4533-8ed1-e7ca5734049f', '67e943fb-40e6-42a3-a3d5-f6f5df5996da', '692ca98c-6dbc-4966-bd1c-0dc1c6272aad'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:32:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Delete snapshot completed successfully. Jun 25 18:32:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-42f98f1d-0430-4842-bc99-f295585a00c5 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-e2916920-5d54-4ce1-888f-2b9db31a709d-delete_snapshot" released by "delete_snapshot" :: held 3.263s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "cinder-32539cd9-45e3-4259-ae64-f8dba89b158f-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-32539cd9-45e3-4259-ae64-f8dba89b158f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "cinder-quobyte-32539cd9-45e3-4259-ae64-f8dba89b158f" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-32539cd9-45e3-4259-ae64-f8dba89b158f" acquired by "delete_volume" :: waited 0.015s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:03 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[826d48b7-9420-4952-bfc9-a5780765a3b7]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:04 devstack sudo[114320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f Jun 25 18:32:04 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:04 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f" returned: 0 in 0.805s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:04 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f Jun 25 18:32:04 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:05 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-32539cd9-45e3-4259-ae64-f8dba89b158f" returned: 0 in 0.710s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-32539cd9-45e3-4259-ae64-f8dba89b158f" released by "delete_volume" :: held 1.577s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:05 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Created reservations ['264a20e3-b776-4517-8b6e-cc3a5b6b1985', 'e040f850-f430-4f78-9f3d-2aef1d19d611', '4d00dd5b-93bf-426a-ab76-59fa7defd2e6', 'a167d0e8-44b6-463b-8395-b036ac47268d'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:32:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:05 devstack sudo[114329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:32:05 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Acquiring lock "cinder-73eefbf6-b929-4c34-b73c-9947ab2a2906-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Lock "cinder-73eefbf6-b929-4c34-b73c-9947ab2a2906-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Acquiring lock "cinder-quobyte-73eefbf6-b929-4c34-b73c-9947ab2a2906" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-73eefbf6-b929-4c34-b73c-9947ab2a2906" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:06 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[12618dcc-5fc3-4707-a3b7-c84197e531fd]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:06 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.673s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:06 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:32:06 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Deleted volume successfully. Jun 25 18:32:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-21e0be44-816e-4c95-8c4a-e33d97dd9f75 tempest-VolumeDependencyTests-819691838 None] Lock "cinder-32539cd9-45e3-4259-ae64-f8dba89b158f-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:06 devstack sudo[114332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 Jun 25 18:32:06 devstack sudo[114332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:07 devstack sudo[114332]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906" returned: 0 in 0.779s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:07 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906 Jun 25 18:32:07 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:07 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73eefbf6-b929-4c34-b73c-9947ab2a2906" returned: 0 in 0.644s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Lock "cinder-quobyte-73eefbf6-b929-4c34-b73c-9947ab2a2906" released by "delete_volume" :: held 1.482s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Created reservations ['cc73521b-a115-42d3-95c4-3a6a4e706a2b', 'a542e4cf-b1e8-4d17-894d-9aa6705050c3', 'ec0be702-f385-4c11-bc06-534932c9a6ac', '715797c2-5226-4e6f-a274-94cdd37d4470'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:07 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:32:07 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:08 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.659s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:08 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:32:08 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Deleted volume successfully. Jun 25 18:32:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f385ddde-9c78-48cf-9465-1f69bd5a2fca tempest-VolumeDependencyTests-819691838 None] Lock "cinder-73eefbf6-b929-4c34-b73c-9947ab2a2906-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Flow 'volume_create_manager' (a44bf580-00c8-40eb-92e7-4357acbe1f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a95f5d-a957-48a9-8d95-31c92fbc6957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a95f5d-a957-48a9-8d95-31c92fbc6957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc250e0e-4b56-4d5b-8e98-10162f4556ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903471ebf8bd4e0ea222c500dfb61352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:11Z,use_quota=True,user_id='396327d17eef41f3aaec2d3374cb08cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470ba899-e5bc-46a2-83a5-1c689d026b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470ba899-e5bc-46a2-83a5-1c689d026b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f962e986-ac4f-4b70-a454-1027256a053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f962e986-ac4f-4b70-a454-1027256a053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc250e0e-4b56-4d5b-8e98-10162f4556ea', 'volume_name': 'volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51f7bdf-7c8e-44f1-82a1-4a499a13590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51f7bdf-7c8e-44f1-82a1-4a499a13590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3f748e-c8b8-4c64-b02e-36ce55f1aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:11 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Volume fc250e0e-4b56-4d5b-8e98-10162f4556ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea', 'volume_size': 1} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc250e0e-4b56-4d5b-8e98-10162f4556ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903471ebf8bd4e0ea222c500dfb61352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:11Z,use_quota=True,user_id='396327d17eef41f3aaec2d3374cb08cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Creating volume fc250e0e-4b56-4d5b-8e98-10162f4556ea {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:32:11 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:32:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:11 devstack sudo[114343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea 1073741824 Jun 25 18:32:11 devstack sudo[114343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:12 devstack sudo[114343]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea 1073741824" returned: 0 in 0.871s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:12 devstack sudo[114348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea Jun 25 18:32:12 devstack sudo[114348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:12 devstack sudo[114348]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea" returned: 0 in 0.615s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:32:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3f748e-c8b8-4c64-b02e-36ce55f1aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36a6d9d-3bf1-45b3-b7a6-4ed5f10eb92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:13 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Volume volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea (fc250e0e-4b56-4d5b-8e98-10162f4556ea): created successfully Jun 25 18:32:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36a6d9d-3bf1-45b3-b7a6-4ed5f10eb92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Flow 'volume_create_manager' (a44bf580-00c8-40eb-92e7-4357acbe1f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:13 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-29b6ca59-f13b-4d75-9428-18b589b111ff tempest-CinderUnicodeTest-583320912 None] Created volume successfully. Jun 25 18:32:13 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Flow 'volume_create_manager' (7d278ff5-a41b-4c10-bac3-426758b3712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a3aa20-3727-42fe-8fef-a34facec7efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a3aa20-3727-42fe-8fef-a34facec7efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2113762641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e63c2f-c47e-4b06-86b8-c61263806539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903471ebf8bd4e0ea222c500dfb61352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:14Z,use_quota=True,user_id='396327d17eef41f3aaec2d3374cb08cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c2ed2d-449f-4143-aaee-685b523f5b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c2ed2d-449f-4143-aaee-685b523f5b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36aa149b-9060-477e-80cf-3af83e72cd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36aa149b-9060-477e-80cf-3af83e72cd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e63c2f-c47e-4b06-86b8-c61263806539', 'volume_name': 'volume-89e63c2f-c47e-4b06-86b8-c61263806539', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1a6aa0-fd4c-4f81-ae6c-79a85d6c8b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1a6aa0-fd4c-4f81-ae6c-79a85d6c8b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a70e41-b5b8-4fa6-a11c-ceeea125b0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:14 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Volume 89e63c2f-c47e-4b06-86b8-c61263806539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e63c2f-c47e-4b06-86b8-c61263806539', 'volume_size': 1} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2113762641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e63c2f-c47e-4b06-86b8-c61263806539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903471ebf8bd4e0ea222c500dfb61352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:14Z,use_quota=True,user_id='396327d17eef41f3aaec2d3374cb08cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Creating volume 89e63c2f-c47e-4b06-86b8-c61263806539 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:32:14 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:14 devstack sudo[114358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 1073741824 Jun 25 18:32:14 devstack sudo[114358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:14 devstack sudo[114358]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 1073741824" returned: 0 in 0.834s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:14 devstack sudo[114363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 Jun 25 18:32:14 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:15 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539" returned: 0 in 0.619s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:32:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a70e41-b5b8-4fa6-a11c-ceeea125b0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e63c2f-c47e-4b06-86b8-c61263806539', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d15057-3ce3-4527-9901-08b0de0d67be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:15 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Volume volume-89e63c2f-c47e-4b06-86b8-c61263806539 (89e63c2f-c47e-4b06-86b8-c61263806539): created successfully Jun 25 18:32:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d15057-3ce3-4527-9901-08b0de0d67be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:15 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Flow 'volume_create_manager' (7d278ff5-a41b-4c10-bac3-426758b3712b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:15 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a7603ed5-3123-41fd-8de1-2433aa1a679f tempest-CinderUnicodeTest-583320912 None] Created volume successfully. Jun 25 18:32:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Creating offline snapshot f8e4f1ab-3a85-4860-a665-36ea8f06040a of volume 89e63c2f-c47e-4b06-86b8-c61263806539 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:32:16 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8c782b-2d5e-410d-b775-768c301aaf26]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:16 devstack sudo[114366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 Jun 25 18:32:16 devstack sudo[114366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:17 devstack sudo[114366]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539" returned: 0 in 0.743s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:17 devstack sudo[114371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a 1G Jun 25 18:32:17 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:17 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a 1G" returned: 0 in 0.809s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89e63c2f-c47e-4b06-86b8-c61263806539 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:17 devstack sudo[114376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89e63c2f-c47e-4b06-86b8-c61263806539 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a Jun 25 18:32:17 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:18 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89e63c2f-c47e-4b06-86b8-c61263806539 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a" returned: 0 in 0.690s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:18 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a is being set with open permissions: ugo+rw Jun 25 18:32:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:18 devstack sudo[114381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a Jun 25 18:32:18 devstack sudo[114381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:19 devstack sudo[114381]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a" returned: 0 in 0.699s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:19 devstack sudo[114384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.info Jun 25 18:32:19 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:19 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.info" returned: 0 in 0.661s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:19 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.info is being set with open permissions: ugo+rw Jun 25 18:32:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:20 devstack sudo[114387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.info Jun 25 18:32:20 devstack sudo[114387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:20 devstack sudo[114387]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.info" returned: 0 in 0.648s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.363s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:20 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-49f70ee0-acf1-4a98-b69f-1e43f92c2245 tempest-CinderUnicodeTest-583320912 None] Create snapshot completed successfully Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Acquiring lock "cinder-f8e4f1ab-3a85-4860-a665-36ea8f06040a-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-f8e4f1ab-3a85-4860-a665-36ea8f06040a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Acquiring lock "cinder-quobyte-89e63c2f-c47e-4b06-86b8-c61263806539" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-quobyte-89e63c2f-c47e-4b06-86b8-c61263806539" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Acquiring lock "cinder-quobyte-f8e4f1ab-3a85-4860-a665-36ea8f06040a" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-quobyte-f8e4f1ab-3a85-4860-a665-36ea8f06040a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Deleting offline snapshot f8e4f1ab-3a85-4860-a665-36ea8f06040a of volume 89e63c2f-c47e-4b06-86b8-c61263806539 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] snapshot_file for this snap is: volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91fab5c-a96c-4dc2-a0b4-b0950285d2d6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:21 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a Jun 25 18:32:21 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:22 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a" returned: 0 in 0.815s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89e63c2f-c47e-4b06-86b8-c61263806539(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:32:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c480ec-bbfd-483f-9df2-da4b210129ec]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:22 devstack sudo[114396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 Jun 25 18:32:22 devstack sudo[114396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:23 devstack sudo[114396]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539" returned: 0 in 0.789s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:23 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a Jun 25 18:32:23 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:24 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a" returned: 0 in 0.741s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:24 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a Jun 25 18:32:24 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:24 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539.f8e4f1ab-3a85-4860-a665-36ea8f06040a" returned: 0 in 0.618s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-quobyte-f8e4f1ab-3a85-4860-a665-36ea8f06040a" released by "_delete_snapshot" :: held 3.096s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-quobyte-89e63c2f-c47e-4b06-86b8-c61263806539" released by "delete_snapshot" :: held 3.118s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:24 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Created reservations ['55f79c77-523f-4ac9-b115-9bf38bec164f', 'cfb633f4-cacc-435f-8f2c-90c958935e77', '1ebc6070-085a-4833-a7d1-b2b54c2239e2', 'cd04b92c-ffb5-4c5a-81cd-240e85524591'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:32:26 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Delete snapshot completed successfully. Jun 25 18:32:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a4acf1fd-46de-4351-a510-57c673a0e741 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-f8e4f1ab-3a85-4860-a665-36ea8f06040a-delete_snapshot" released by "delete_snapshot" :: held 5.195s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Acquiring lock "cinder-89e63c2f-c47e-4b06-86b8-c61263806539-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-89e63c2f-c47e-4b06-86b8-c61263806539-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Acquiring lock "cinder-quobyte-89e63c2f-c47e-4b06-86b8-c61263806539" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-quobyte-89e63c2f-c47e-4b06-86b8-c61263806539" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d783ff-5fe1-45ac-917e-3181b217a538]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:29 devstack sudo[114412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 Jun 25 18:32:29 devstack sudo[114412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:29 devstack sudo[114412]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539" returned: 0 in 0.790s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:29 devstack sudo[114417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539 Jun 25 18:32:29 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:30 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-89e63c2f-c47e-4b06-86b8-c61263806539" returned: 0 in 0.639s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-quobyte-89e63c2f-c47e-4b06-86b8-c61263806539" released by "delete_volume" :: held 1.490s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:30 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Created reservations ['ed147480-d874-430c-80ec-448599b765f5', 'd99f9288-31cb-4508-83b9-5a9e89a17d27', 'c80575e5-18e5-4ba2-8fa4-57ee9959b52d', '7da05af9-a2f9-46f7-90cc-c4c818be4ccc'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:32:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:30 devstack sudo[114420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:32:30 devstack sudo[114420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Acquiring lock "cinder-fc250e0e-4b56-4d5b-8e98-10162f4556ea-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Lock "cinder-fc250e0e-4b56-4d5b-8e98-10162f4556ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Acquiring lock "cinder-quobyte-fc250e0e-4b56-4d5b-8e98-10162f4556ea" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Lock "cinder-quobyte-fc250e0e-4b56-4d5b-8e98-10162f4556ea" acquired by "delete_volume" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:31 devstack sudo[114420]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.690s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:31 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:32:31 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Deleted volume successfully. Jun 25 18:32:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[28205045-40e3-4fe2-97db-67dd25cf8ec9]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:31 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d504708a-dac8-4d8c-88fd-16804f3b6051 tempest-CinderUnicodeTest-583320912 None] Lock "cinder-89e63c2f-c47e-4b06-86b8-c61263806539-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:31 devstack sudo[114423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea Jun 25 18:32:31 devstack sudo[114423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:32 devstack sudo[114423]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea" returned: 0 in 0.793s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:32 devstack sudo[114428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea Jun 25 18:32:32 devstack sudo[114428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:32 devstack sudo[114428]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-fc250e0e-4b56-4d5b-8e98-10162f4556ea" returned: 0 in 0.627s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Lock "cinder-quobyte-fc250e0e-4b56-4d5b-8e98-10162f4556ea" released by "delete_volume" :: held 1.470s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Created reservations ['7713d5c2-9693-47f5-8fb2-dc70403a1601', '955e5f6f-b2f8-45b8-aa18-3c5bf99b7784', 'b25c4491-f1c6-4696-a777-faefa547b26f', 'ceb9e18c-1d00-4699-9f25-6a84bb0dd238'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:32 devstack sudo[114432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:32:32 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:33 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.670s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:33 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:32:33 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Deleted volume successfully. Jun 25 18:32:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-cf191a3c-a3d4-4a8d-9089-5db9e5454ffa tempest-CinderUnicodeTest-583320912 None] Lock "cinder-fc250e0e-4b56-4d5b-8e98-10162f4556ea-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:32:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:40 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:32:40 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:41 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.707s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:32:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:32:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:32:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:32:42 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=42,cinder:INSERT=13,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:32:43 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=51,cinder:UPDATE=57,cinder:DELETE=5,cinder:INSERT=16 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (0a293bd9-c71c-49e3-81bc-55955d765799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfa9dc4-78bc-46d6-9586-9f5215f6f1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfa9dc4-78bc-46d6-9586-9f5215f6f1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647162780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7498206a-c69d-4a45-8357-9e4e6b086e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:46Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd7688b-8e91-4a28-aad6-89f9af8f3ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd7688b-8e91-4a28-aad6-89f9af8f3ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686765c0-db1b-4307-b139-685df5ac5583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686765c0-db1b-4307-b139-685df5ac5583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7498206a-c69d-4a45-8357-9e4e6b086e6f', 'volume_name': 'volume-7498206a-c69d-4a45-8357-9e4e6b086e6f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614f472e-8db8-4b93-93d2-0f6ec4a3e96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614f472e-8db8-4b93-93d2-0f6ec4a3e96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acdf6d3-32f5-476b-a6dc-244d9b76d630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume 7498206a-c69d-4a45-8357-9e4e6b086e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7498206a-c69d-4a45-8357-9e4e6b086e6f', 'volume_size': 1} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647162780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7498206a-c69d-4a45-8357-9e4e6b086e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:46Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Creating volume 7498206a-c69d-4a45-8357-9e4e6b086e6f {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:32:46 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:46 devstack sudo[114479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f 1073741824 Jun 25 18:32:46 devstack sudo[114479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (bb40050e-976c-4db1-bc09-11c9fe13b4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03133513-5d99-4e63-b467-71e4615837fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03133513-5d99-4e63-b467-71e4615837fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-319095746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165aeb30-26ef-4b6a-841b-a6d3968ae03e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:46Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cd7a93-e6a2-483b-8c37-f31c63b148ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cd7a93-e6a2-483b-8c37-f31c63b148ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b827b73-0059-4836-959d-50fc3d1e5d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b827b73-0059-4836-959d-50fc3d1e5d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165aeb30-26ef-4b6a-841b-a6d3968ae03e', 'volume_name': 'volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496ca7d4-bb00-4d35-8889-cc4de6013bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496ca7d4-bb00-4d35-8889-cc4de6013bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6019a93-97bf-4a12-8df5-fa2d9516fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Volume 165aeb30-26ef-4b6a-841b-a6d3968ae03e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e', 'volume_size': 1} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (7f415931-3650-46ee-aab5-75e95d482cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d7e0db-a0aa-48eb-ba2f-caaa803660be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d7e0db-a0aa-48eb-ba2f-caaa803660be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1916029997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d52d3dc-9754-42a6-b288-7562297e4d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:47Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa0137f-63d6-485a-bd16-bc4584b1ccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa0137f-63d6-485a-bd16-bc4584b1ccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8cdc0f-85ed-41cc-9106-506acbf64287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8cdc0f-85ed-41cc-9106-506acbf64287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d52d3dc-9754-42a6-b288-7562297e4d51', 'volume_name': 'volume-1d52d3dc-9754-42a6-b288-7562297e4d51', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404cab02-2c97-4f16-ab42-6c10feae1276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404cab02-2c97-4f16-ab42-6c10feae1276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481f2df9-8228-40bb-9d1c-609d47de54c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:46 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Volume 1d52d3dc-9754-42a6-b288-7562297e4d51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d52d3dc-9754-42a6-b288-7562297e4d51', 'volume_size': 1} Jun 25 18:32:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Flow 'volume_create_manager' (c761ae69-91c6-4e4d-8d85-40215c269f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10ce4b-0681-4c91-ba05-38de55501129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10ce4b-0681-4c91-ba05-38de55501129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eeca519-a871-4aac-89e6-00de486a7c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f660dd5d13e847899b42d50f2df4bc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:47Z,use_quota=True,user_id='b03c85913df142e99393e495bd3d2fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827ed0e3-3ed5-44b9-a7e3-901a62c6a380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack sudo[114479]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827ed0e3-3ed5-44b9-a7e3-901a62c6a380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caee3c3f-b191-4d6a-9eb7-6f5c77043c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caee3c3f-b191-4d6a-9eb7-6f5c77043c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eeca519-a871-4aac-89e6-00de486a7c09', 'volume_name': 'volume-6eeca519-a871-4aac-89e6-00de486a7c09', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4231736-8161-4363-a90b-b22f50317580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4231736-8161-4363-a90b-b22f50317580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f88bc2-b401-46b0-b13e-4dbf31b771c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Volume 6eeca519-a871-4aac-89e6-00de486a7c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eeca519-a871-4aac-89e6-00de486a7c09', 'volume_size': 1} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f 1073741824" returned: 0 in 1.247s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:47 devstack sudo[114486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f Jun 25 18:32:47 devstack sudo[114486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (4186ac82-4d08-4d3c-b537-baf9d1f38885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ef7ffe-ed41-4494-9f54-482d554b9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ef7ffe-ed41-4494-9f54-482d554b9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455811326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d450df4d-81f1-4b35-8fad-23915d50b243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:48Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628d4ff4-02e5-4117-aa64-0ba5e7c70e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628d4ff4-02e5-4117-aa64-0ba5e7c70e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3e7e2c-7348-47ff-9e9d-732c0828d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3e7e2c-7348-47ff-9e9d-732c0828d600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd450df4d-81f1-4b35-8fad-23915d50b243', 'volume_name': 'volume-d450df4d-81f1-4b35-8fad-23915d50b243', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8c5fa3-5493-4589-a66c-76e5cf64c5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8c5fa3-5493-4589-a66c-76e5cf64c5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d1a240-4371-4a7b-b67a-7b39f4134e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:47 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Volume d450df4d-81f1-4b35-8fad-23915d50b243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d450df4d-81f1-4b35-8fad-23915d50b243', 'volume_size': 1} Jun 25 18:32:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (e7b5f32e-ff07-4ec5-b251-624c45b31704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db89f633-be24-4393-8da5-59330972253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db89f633-be24-4393-8da5-59330972253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105580524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0798129e-57d3-474b-97b7-3e37ed426f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:48Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64e9de9-6307-4217-974b-fad100d6e6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64e9de9-6307-4217-974b-fad100d6e6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81570874-0330-47f7-8204-9afc2c6338cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81570874-0330-47f7-8204-9afc2c6338cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0798129e-57d3-474b-97b7-3e37ed426f76', 'volume_name': 'volume-0798129e-57d3-474b-97b7-3e37ed426f76', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff048d7-2f22-4128-a529-b7ac0817882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff048d7-2f22-4128-a529-b7ac0817882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3feb8a2-3fb6-4a68-9d41-158f5f286707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Volume 0798129e-57d3-474b-97b7-3e37ed426f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0798129e-57d3-474b-97b7-3e37ed426f76', 'volume_size': 1} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:48 devstack sudo[114486]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f" returned: 0 in 0.810s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-319095746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165aeb30-26ef-4b6a-841b-a6d3968ae03e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:46Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Creating volume 165aeb30-26ef-4b6a-841b-a6d3968ae03e {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:32:48 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:48 devstack sudo[114489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e 1073741824 Jun 25 18:32:48 devstack sudo[114489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (73685b47-d901-4c0c-b856-4cd276711aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3be5dc-d922-49c5-9df6-60e7f82b97c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acdf6d3-32f5-476b-a6dc-244d9b76d630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7498206a-c69d-4a45-8357-9e4e6b086e6f', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afe9a06-8a29-4292-9085-ae0fa3a5b300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3be5dc-d922-49c5-9df6-60e7f82b97c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-257020775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987c2f63-e246-4875-9c41-60f3cc96389e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:48Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65f1e73-a441-425a-84dc-96c32e3651e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65f1e73-a441-425a-84dc-96c32e3651e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548a74c2-0b9b-4036-8229-e1a478bd1d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548a74c2-0b9b-4036-8229-e1a478bd1d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987c2f63-e246-4875-9c41-60f3cc96389e', 'volume_name': 'volume-987c2f63-e246-4875-9c41-60f3cc96389e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c67531-d7cb-4d37-bb9f-a3b99750b5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c67531-d7cb-4d37-bb9f-a3b99750b5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372a6570-8e23-4d73-a14c-8b5f56ba6601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Volume 987c2f63-e246-4875-9c41-60f3cc96389e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987c2f63-e246-4875-9c41-60f3cc96389e', 'volume_size': 1} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume volume-7498206a-c69d-4a45-8357-9e4e6b086e6f (7498206a-c69d-4a45-8357-9e4e6b086e6f): created successfully Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afe9a06-8a29-4292-9085-ae0fa3a5b300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (0a293bd9-c71c-49e3-81bc-55955d765799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:48 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1bd3fae1-dc35-426b-872e-5bc5cdcb561c tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created volume successfully. Jun 25 18:32:49 devstack sudo[114489]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e 1073741824" returned: 0 in 0.863s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:49 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e Jun 25 18:32:49 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:50 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e" returned: 0 in 0.675s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.099s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1916029997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d52d3dc-9754-42a6-b288-7562297e4d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:47Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Creating volume 1d52d3dc-9754-42a6-b288-7562297e4d51 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:32:50 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:50 devstack sudo[114498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51 1073741824 Jun 25 18:32:50 devstack sudo[114498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6019a93-97bf-4a12-8df5-fa2d9516fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4573ece4-de1f-4c84-a246-0d9ea4053efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:50 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Volume volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e (165aeb30-26ef-4b6a-841b-a6d3968ae03e): created successfully Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4573ece4-de1f-4c84-a246-0d9ea4053efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (bb40050e-976c-4db1-bc09-11c9fe13b4d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:50 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-7b8b74c9-f9a7-4833-b46d-d2bbea063d75 tempest-CreateVolumesFromImageTest-524164166 None] Created volume successfully. Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Flow 'volume_create_manager' (79e6d0cb-6b71-4428-9e7c-f2be51ded8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f41250f-d3bc-40c8-b611-6a3492881e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f41250f-d3bc-40c8-b611-6a3492881e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41827311-7121-48b6-942d-653408dac651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049d52455c3240e9827709d35788b869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:51Z,use_quota=True,user_id='1694dc483bbf4a5e85b800b6784e2e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ceece97-472f-47b3-bf74-daf2ec992d52),volume_type_id=2ceece97-472f-47b3-bf74-daf2ec992d52)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98722ec-9db9-4f6a-81aa-7c2b41ee9819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98722ec-9db9-4f6a-81aa-7c2b41ee9819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5269030d-7461-4252-b7b9-1803e830ebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG cinder.image.glance [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Creating Keystone auth plugin from conf {{(pid=93767) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:32:50 devstack sudo[114498]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51 1073741824" returned: 0 in 0.908s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:51 devstack sudo[114504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51 Jun 25 18:32:51 devstack sudo[114504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5269030d-7461-4252-b7b9-1803e830ebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41827311-7121-48b6-942d-653408dac651', 'volume_name': 'volume-41827311-7121-48b6-942d-653408dac651', 'volume_size': 1, 'image_id': '9bd84b26-4d62-4746-807c-a6d5918c734e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bd84b26-4d62-4746-807c-a6d5918c734e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04331e6fd0846b52cd5efc1ed103a281', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '049d52455c3240e9827709d35788b869', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '991eb941e7e608de7df697b7e10cad4835f8017f571b8dfab63c44d6fd9a666276039930c33b3f28b41b5e0ac0e1e361e3ec2a09916842e655c766bd8b9fa71c', 'id': '9bd84b26-4d62-4746-807c-a6d5918c734e', 'created_at': datetime.datetime(2026, 6, 25, 16, 32, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 32, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bd84b26-4d62-4746-807c-a6d5918c734e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e58ac63-876a-448c-98be-5aa1b41a7eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e58ac63-876a-448c-98be-5aa1b41a7eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64483bb8-2b5c-41ab-afb5-62bd7e1c194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:51 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Volume 41827311-7121-48b6-942d-653408dac651: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41827311-7121-48b6-942d-653408dac651', 'volume_size': 1, 'image_id': '9bd84b26-4d62-4746-807c-a6d5918c734e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bd84b26-4d62-4746-807c-a6d5918c734e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04331e6fd0846b52cd5efc1ed103a281', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '049d52455c3240e9827709d35788b869', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '991eb941e7e608de7df697b7e10cad4835f8017f571b8dfab63c44d6fd9a666276039930c33b3f28b41b5e0ac0e1e361e3ec2a09916842e655c766bd8b9fa71c', 'id': '9bd84b26-4d62-4746-807c-a6d5918c734e', 'created_at': datetime.datetime(2026, 6, 25, 16, 32, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 32, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bd84b26-4d62-4746-807c-a6d5918c734e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Trying to clone 41827311-7121-48b6-942d-653408dac651 from image 9bd84b26-4d62-4746-807c-a6d5918c734e at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bd84b26-4d62-4746-807c-a6d5918c734e', 'metadata': {}}]). {{(pid=93767) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:32:51 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Image download 0.00 MB at 0.00 MB/s Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a16f6f6-2d97-4eb7-887e-6bc8fcea58b1]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:51 devstack sudo[114506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD Jun 25 18:32:51 devstack sudo[114506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:51 devstack sudo[114504]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51" returned: 0 in 0.658s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.080s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eeca519-a871-4aac-89e6-00de486a7c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f660dd5d13e847899b42d50f2df4bc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:47Z,use_quota=True,user_id='b03c85913df142e99393e495bd3d2fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Creating volume 6eeca519-a871-4aac-89e6-00de486a7c09 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:32:51 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481f2df9-8228-40bb-9d1c-609d47de54c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d52d3dc-9754-42a6-b288-7562297e4d51', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31097b89-95b4-4901-a30d-7afb7bc7b376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:51 devstack sudo[114509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09 1073741824 Jun 25 18:32:51 devstack sudo[114509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:51 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Volume volume-1d52d3dc-9754-42a6-b288-7562297e4d51 (1d52d3dc-9754-42a6-b288-7562297e4d51): created successfully Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31097b89-95b4-4901-a30d-7afb7bc7b376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (7f415931-3650-46ee-aab5-75e95d482cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-dad962d7-9d14-4044-b368-79d9a6f212ed tempest-CreateVolumesFromImageTest-524164166 None] Created volume successfully. Jun 25 18:32:52 devstack sudo[114506]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD" returned: 0 in 0.727s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:52 devstack sudo[114513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD Jun 25 18:32:52 devstack sudo[114513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:52 devstack sudo[114509]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09 1073741824" returned: 0 in 0.843s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:52 devstack sudo[114519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09 Jun 25 18:32:52 devstack sudo[114519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:52 devstack sudo[114513]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD" returned: 1 in 0.734s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:32:52 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Temporary image 9bd84b26-4d62-4746-807c-a6d5918c734e is fetched for user 1694dc483bbf4a5e85b800b6784e2e2a. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:32:52 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[decc4dd5-b1a6-420f-848e-335c6438aba0]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:52 devstack sudo[114524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD Jun 25 18:32:52 devstack sudo[114524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:53 devstack sudo[114519]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09" returned: 0 in 0.636s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.285s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455811326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d450df4d-81f1-4b35-8fad-23915d50b243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:48Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Creating volume d450df4d-81f1-4b35-8fad-23915d50b243 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:32:53 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f88bc2-b401-46b0-b13e-4dbf31b771c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eeca519-a871-4aac-89e6-00de486a7c09', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:53 devstack sudo[114528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243 1073741824 Jun 25 18:32:53 devstack sudo[114528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961301bf-d1d4-404e-8b8b-9bf475d6a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:53 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Volume volume-6eeca519-a871-4aac-89e6-00de486a7c09 (6eeca519-a871-4aac-89e6-00de486a7c09): created successfully Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961301bf-d1d4-404e-8b8b-9bf475d6a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Flow 'volume_create_manager' (c761ae69-91c6-4e4d-8d85-40215c269f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:53 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0fb39b31-d700-4da9-a54b-4fb5afe190b5 tempest-CinderUnicodeTest-2127034240 None] Created volume successfully. Jun 25 18:32:53 devstack sudo[114524]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD" returned: 0 in 0.721s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:53 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD Jun 25 18:32:53 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:54 devstack sudo[114528]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243 1073741824" returned: 0 in 0.978s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Flow 'volume_create_manager' (ea57c487-168d-4d52-8ba3-33f8c3afed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8778daf-dcd7-4328-8e6e-dcdb940e105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8778daf-dcd7-4328-8e6e-dcdb940e105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1552893602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380e778f-d14c-42ab-bd8f-bb18e6184846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f660dd5d13e847899b42d50f2df4bc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:54Z,use_quota=True,user_id='b03c85913df142e99393e495bd3d2fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:54 devstack sudo[114538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243 Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2240447b-3857-4335-a24c-dbd42137e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:54 devstack sudo[114538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2240447b-3857-4335-a24c-dbd42137e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924c3b8c-f986-43ab-bfb5-d7d71ad97a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924c3b8c-f986-43ab-bfb5-d7d71ad97a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '380e778f-d14c-42ab-bd8f-bb18e6184846', 'volume_name': 'volume-380e778f-d14c-42ab-bd8f-bb18e6184846', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0324f147-213b-4bc2-84bf-fb50ac2b76d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0324f147-213b-4bc2-84bf-fb50ac2b76d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724df83d-8419-4f17-8505-7101d04f31fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:54 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Volume 380e778f-d14c-42ab-bd8f-bb18e6184846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-380e778f-d14c-42ab-bd8f-bb18e6184846', 'volume_size': 1} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:54 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD" returned: 1 in 0.860s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:54 devstack sudo[114538]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243" returned: 0 in 0.697s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.824s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105580524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0798129e-57d3-474b-97b7-3e37ed426f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:48Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Creating volume 0798129e-57d3-474b-97b7-3e37ed426f76 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:32:54 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:32:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:54 devstack sudo[114580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76 1073741824 Jun 25 18:32:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d1a240-4371-4a7b-b67a-7b39f4134e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d450df4d-81f1-4b35-8fad-23915d50b243', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:54 devstack sudo[114580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c68d5d8-1440-4120-8f1f-2afacc665421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:55 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Volume volume-d450df4d-81f1-4b35-8fad-23915d50b243 (d450df4d-81f1-4b35-8fad-23915d50b243): created successfully Jun 25 18:32:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c68d5d8-1440-4120-8f1f-2afacc665421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (4186ac82-4d08-4d3c-b537-baf9d1f38885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:55 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8226c788-c718-4de1-8367-45623266a524 tempest-CreateVolumesFromImageTest-524164166 None] Created volume successfully. Jun 25 18:32:55 devstack sudo[114580]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76 1073741824" returned: 0 in 0.796s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:55 devstack sudo[114585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76 Jun 25 18:32:55 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:56 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76" returned: 0 in 0.631s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.867s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-257020775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987c2f63-e246-4875-9c41-60f3cc96389e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e11632e9d7493d9d7efed2c2644127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:48Z,use_quota=True,user_id='3c72ab993df14a95995ef9565ea7849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Creating volume 987c2f63-e246-4875-9c41-60f3cc96389e {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:32:56 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3feb8a2-3fb6-4a68-9d41-158f5f286707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0798129e-57d3-474b-97b7-3e37ed426f76', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:56 devstack sudo[114588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e 1073741824 Jun 25 18:32:56 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb02eeb4-7ef2-4158-b3a8-eb123161fa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:56 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Volume volume-0798129e-57d3-474b-97b7-3e37ed426f76 (0798129e-57d3-474b-97b7-3e37ed426f76): created successfully Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb02eeb4-7ef2-4158-b3a8-eb123161fa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:56 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (e7b5f32e-ff07-4ec5-b251-624c45b31704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:56 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2aa1116d-862c-414c-8b99-909055ad5c63 tempest-CreateVolumesFromImageTest-524164166 None] Created volume successfully. Jun 25 18:32:57 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e 1073741824" returned: 0 in 0.823s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:57 devstack sudo[114594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e Jun 25 18:32:57 devstack sudo[114594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:57 devstack sudo[114594]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e" returned: 0 in 0.626s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.290s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372a6570-8e23-4d73-a14c-8b5f56ba6601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987c2f63-e246-4875-9c41-60f3cc96389e', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57068368-5e61-426c-a1f8-a226d78923fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Creating offline snapshot 8f3ea086-2533-453b-a840-1e8c32ec50c9 of volume 7498206a-c69d-4a45-8357-9e4e6b086e6f {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:32:57 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Volume volume-987c2f63-e246-4875-9c41-60f3cc96389e (987c2f63-e246-4875-9c41-60f3cc96389e): created successfully Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57068368-5e61-426c-a1f8-a226d78923fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Flow 'volume_create_manager' (73685b47-d901-4c0c-b856-4cd276711aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[014818f7-d25d-4d7a-9578-9a956e0cb253]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:58 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a229cba3-f040-48b5-8325-d149ddb5cbbb tempest-CreateVolumesFromImageTest-524164166 None] Created volume successfully. Jun 25 18:32:58 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f Jun 25 18:32:58 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-987c2f63-e246-4875-9c41-60f3cc96389e-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-987c2f63-e246-4875-9c41-60f3cc96389e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-quobyte-987c2f63-e246-4875-9c41-60f3cc96389e" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:32:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-987c2f63-e246-4875-9c41-60f3cc96389e" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:32:58 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddce7942-9709-41da-a9f7-20974acf13d7]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:32:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:58 devstack sudo[114599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e Jun 25 18:32:58 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:58 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f" returned: 0 in 0.791s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:58 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 1G Jun 25 18:32:58 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:59 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e" returned: 0 in 0.727s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:59 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e Jun 25 18:32:59 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:59 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 1G" returned: 0 in 0.815s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7498206a-c69d-4a45-8357-9e4e6b086e6f -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:32:59 devstack sudo[114615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7498206a-c69d-4a45-8357-9e4e6b086e6f -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 Jun 25 18:32:59 devstack sudo[114615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:32:59 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Jun 25 18:32:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-987c2f63-e246-4875-9c41-60f3cc96389e" returned: 0 in 0.754s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:32:59 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-987c2f63-e246-4875-9c41-60f3cc96389e" released by "delete_volume" :: held 1.532s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:32:59 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Created reservations ['54f05abf-a6a4-41b8-95a7-083ef373ddda', '67b77d22-87e3-41f9-adf9-577e570cfb68', '89a9c60e-3f17-4aa6-82ce-e381ee2712a6', '1e6c6438-9119-4c20-b3ce-d999454272b1'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:00 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:00 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:00 devstack sudo[114615]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7498206a-c69d-4a45-8357-9e4e6b086e6f -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9" returned: 0 in 0.762s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:00 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 is being set with open permissions: ugo+rw Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:00 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 Jun 25 18:33:00 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-0798129e-57d3-474b-97b7-3e37ed426f76-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-0798129e-57d3-474b-97b7-3e37ed426f76-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-quobyte-0798129e-57d3-474b-97b7-3e37ed426f76" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-0798129e-57d3-474b-97b7-3e37ed426f76" acquired by "delete_volume" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f04c52-51d9-45ee-8e4f-e539b04784ff]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:00 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.704s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:00 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Deleted volume successfully. Jun 25 18:33:00 devstack sudo[114627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76 Jun 25 18:33:00 devstack sudo[114627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:00 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-7b19abae-70d5-4b59-bd5e-8e35e6df720b tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-987c2f63-e246-4875-9c41-60f3cc96389e-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:01 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9" returned: 0 in 0.797s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:01 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.info Jun 25 18:33:01 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:01 devstack sudo[114627]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76" returned: 0 in 0.824s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:01 devstack sudo[114635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76 Jun 25 18:33:01 devstack sudo[114635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:01 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.info" returned: 0 in 0.675s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:01 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.info is being set with open permissions: ugo+rw Jun 25 18:33:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:01 devstack sudo[114638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.info Jun 25 18:33:01 devstack sudo[114638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:02 devstack sudo[114635]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0798129e-57d3-474b-97b7-3e37ed426f76" returned: 0 in 0.704s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-0798129e-57d3-474b-97b7-3e37ed426f76" released by "delete_volume" :: held 1.587s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Created reservations ['f489c7eb-7908-4fce-b2a0-676776992548', '1e32dbe4-296a-4cb8-81cf-af0dc9986276', '2b6259a5-1296-4897-8eac-2c3d440a33c8', '395f7342-921c-42e7-bef8-c32444a0b534'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:02 devstack sudo[114641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:02 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:02 devstack sudo[114638]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.info" returned: 0 in 0.675s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.657s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.276s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1552893602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380e778f-d14c-42ab-bd8f-bb18e6184846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f660dd5d13e847899b42d50f2df4bc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:54Z,use_quota=True,user_id='b03c85913df142e99393e495bd3d2fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Creating volume 380e778f-d14c-42ab-bd8f-bb18e6184846 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:02 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:02 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 1073741824 Jun 25 18:33:02 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-032f512f-c98d-44b5-a2e1-1dd61eb4b137 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Create snapshot completed successfully Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-d450df4d-81f1-4b35-8fad-23915d50b243-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-d450df4d-81f1-4b35-8fad-23915d50b243-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-quobyte-d450df4d-81f1-4b35-8fad-23915d50b243" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-d450df4d-81f1-4b35-8fad-23915d50b243" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5421a2-7712-43a3-af6d-f057ee78a03f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:03 devstack sudo[114648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243 Jun 25 18:33:03 devstack sudo[114648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:03 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.742s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:03 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Deleted volume successfully. Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-2cc1f9e1-5c9e-4254-ac07-ae29910b876f tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-0798129e-57d3-474b-97b7-3e37ed426f76-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:03 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 1073741824" returned: 0 in 0.992s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:03 devstack sudo[114654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 Jun 25 18:33:03 devstack sudo[114654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (14954326-b06e-4bf9-a234-931c3348f8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6bbbcc-98bc-478b-b085-9eaa3e0e3691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6bbbcc-98bc-478b-b085-9eaa3e0e3691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970765463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9aa3569-52cf-486c-8596-c6c449d04d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:04Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd03cd3-390b-4669-ad2e-e120326a194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:03 devstack sudo[114648]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd03cd3-390b-4669-ad2e-e120326a194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948670e-8115-4a47-9960-b9026deed87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948670e-8115-4a47-9960-b9026deed87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9aa3569-52cf-486c-8596-c6c449d04d62', 'volume_name': 'volume-a9aa3569-52cf-486c-8596-c6c449d04d62', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e3a3e0-de2e-4e9c-95a8-9d138a59c7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e3a3e0-de2e-4e9c-95a8-9d138a59c7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df527aca-23e3-4984-b720-96225e4d3d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:03 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume a9aa3569-52cf-486c-8596-c6c449d04d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9aa3569-52cf-486c-8596-c6c449d04d62', 'volume_size': 1} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243" returned: 0 in 0.956s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:03 devstack sudo[114660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243 Jun 25 18:33:03 devstack sudo[114660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (257cd172-b26b-4266-bf2f-692e2a8269e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa1caa9-cd9d-4f3e-944f-61576dfb58c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa1caa9-cd9d-4f3e-944f-61576dfb58c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-685165626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac48aa6-934c-4db6-8afb-cdb05db08334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:04Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10a9177-6b5e-4b95-8ff1-93d942a23204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10a9177-6b5e-4b95-8ff1-93d942a23204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55f4de0-ff2d-452d-9642-77216815fb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55f4de0-ff2d-452d-9642-77216815fb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac48aa6-934c-4db6-8afb-cdb05db08334', 'volume_name': 'volume-8ac48aa6-934c-4db6-8afb-cdb05db08334', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107f4ab8-460a-4a4a-9875-e4634f6bed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107f4ab8-460a-4a4a-9875-e4634f6bed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f183a09-79e3-47db-9e93-70bf307122da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume 8ac48aa6-934c-4db6-8afb-cdb05db08334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac48aa6-934c-4db6-8afb-cdb05db08334', 'volume_size': 1} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:04 devstack sudo[114654]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846" returned: 0 in 0.783s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.966s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41827311-7121-48b6-942d-653408dac651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049d52455c3240e9827709d35788b869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:32:51Z,use_quota=True,user_id='1694dc483bbf4a5e85b800b6784e2e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ceece97-472f-47b3-bf74-daf2ec992d52),volume_type_id=2ceece97-472f-47b3-bf74-daf2ec992d52)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Creating volume 41827311-7121-48b6-942d-653408dac651 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:04 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724df83d-8419-4f17-8505-7101d04f31fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380e778f-d14c-42ab-bd8f-bb18e6184846', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack sudo[114663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 1073741824 Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7108b6d8-160a-4c5a-9e69-f9cdb48fa69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack sudo[114663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:04 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Volume volume-380e778f-d14c-42ab-bd8f-bb18e6184846 (380e778f-d14c-42ab-bd8f-bb18e6184846): created successfully Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7108b6d8-160a-4c5a-9e69-f9cdb48fa69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Flow 'volume_create_manager' (ea57c487-168d-4d52-8ba3-33f8c3afed0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2ae0cb77-d863-416e-9a09-79e370cf5b6f tempest-CinderUnicodeTest-2127034240 None] Created volume successfully. Jun 25 18:33:04 devstack sudo[114660]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-d450df4d-81f1-4b35-8fad-23915d50b243" returned: 0 in 0.778s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-d450df4d-81f1-4b35-8fad-23915d50b243" released by "delete_volume" :: held 1.794s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (0cca830a-f950-4895-9915-894c376935a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca89529f-ab31-428a-95f4-a0b84cfa7ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Created reservations ['20347a35-de3f-4192-912f-e9db496d6a8a', 'cb75853b-2ab0-4d89-ad64-811bdbcdba4a', 'da7151ad-5fe1-402d-967f-137303431f4b', 'bba73653-1ee2-46e5-9154-4182a7e6328f'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca89529f-ab31-428a-95f4-a0b84cfa7ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257163247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be61cf4a-e142-4276-bcc0-5fcb5420148c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:05Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88015bb3-e927-4fb2-87bf-f9503a7db36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88015bb3-e927-4fb2-87bf-f9503a7db36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c0b760-4597-4c47-a49f-506ff125791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c0b760-4597-4c47-a49f-506ff125791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be61cf4a-e142-4276-bcc0-5fcb5420148c', 'volume_name': 'volume-be61cf4a-e142-4276-bcc0-5fcb5420148c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278a80ff-0d2a-4ac2-8761-fb932669cd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278a80ff-0d2a-4ac2-8761-fb932669cd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5454130-cc4d-43be-a94d-c1cf5680940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:04 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume be61cf4a-e142-4276-bcc0-5fcb5420148c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be61cf4a-e142-4276-bcc0-5fcb5420148c', 'volume_size': 1} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:05 devstack sudo[114666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:05 devstack sudo[114666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-1d52d3dc-9754-42a6-b288-7562297e4d51-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-1d52d3dc-9754-42a6-b288-7562297e4d51-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-quobyte-1d52d3dc-9754-42a6-b288-7562297e4d51" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-1d52d3dc-9754-42a6-b288-7562297e4d51" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4397cb3-0fc7-44d5-8611-9f67205c2363]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:05 devstack sudo[114671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51 Jun 25 18:33:05 devstack sudo[114671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (8f3745bd-dff9-4c74-a187-90d1887abb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d5dc86-dbf2-4919-8d5c-588bb788e31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d5dc86-dbf2-4919-8d5c-588bb788e31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-335367906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c4633-354c-47fa-8e16-e7bb4de3d035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:05Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1e46ee-e5ad-4e63-a70a-0b1b472f2bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1e46ee-e5ad-4e63-a70a-0b1b472f2bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36502c14-2df5-4d6d-8ee5-9dbf3dba2792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36502c14-2df5-4d6d-8ee5-9dbf3dba2792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15c4633-354c-47fa-8e16-e7bb4de3d035', 'volume_name': 'volume-b15c4633-354c-47fa-8e16-e7bb4de3d035', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8158fac6-a13a-4049-95ed-a63df10e5aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8158fac6-a13a-4049-95ed-a63df10e5aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e318dac1-75a5-4e53-8403-91b6f920da71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume b15c4633-354c-47fa-8e16-e7bb4de3d035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15c4633-354c-47fa-8e16-e7bb4de3d035', 'volume_size': 1} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:05 devstack sudo[114663]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 1073741824" returned: 0 in 1.236s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:05 devstack sudo[114674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 Jun 25 18:33:05 devstack sudo[114674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (9f1743a1-ef06-47af-a63b-28622120fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25a36fc-8022-4e4d-bbdc-643b84e51e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25a36fc-8022-4e4d-bbdc-643b84e51e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215499515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c3308a-3ae2-4b59-b377-b4de3ac990c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:06Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7efdff1-f6de-42bc-b6c3-532d1952d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack sudo[114666]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7efdff1-f6de-42bc-b6c3-532d1952d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ccf3b2-bbb8-4b9f-8906-5622ba9c52e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ccf3b2-bbb8-4b9f-8906-5622ba9c52e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c3308a-3ae2-4b59-b377-b4de3ac990c4', 'volume_name': 'volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bd4a82-2c52-43e3-85a1-27e84ff7619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bd4a82-2c52-43e3-85a1-27e84ff7619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b5e6c1-0012-4f33-a0a2-a43e155f93a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:05 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume 46c3308a-3ae2-4b59-b377-b4de3ac990c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4', 'volume_size': 1} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.996s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:05 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:05 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Deleted volume successfully. Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ba6b06b1-00ee-40fa-9f6a-91c1de3d8c2e tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-d450df4d-81f1-4b35-8fad-23915d50b243-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:06 devstack sudo[114671]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51" returned: 0 in 0.991s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:06 devstack sudo[114681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51 Jun 25 18:33:06 devstack sudo[114681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:06 devstack sudo[114674]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651" returned: 0 in 0.696s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.499s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970765463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9aa3569-52cf-486c-8596-c6c449d04d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:04Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Creating volume a9aa3569-52cf-486c-8596-c6c449d04d62 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:06 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:06 devstack sudo[114683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62 1073741824 Jun 25 18:33:06 devstack sudo[114683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Attempting download of 9bd84b26-4d62-4746-807c-a6d5918c734e ((None, [{'url': 'file:///opt/stack/data/glance/images/9bd84b26-4d62-4746-807c-a6d5918c734e', 'metadata': {}}])) to volume 41827311-7121-48b6-942d-653408dac651. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecaa108-1ee9-4102-bf46-d689b3b08fc9]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bd84b26-4d62-4746-807c-a6d5918c734e_49wlp6b8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:06 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bd84b26-4d62-4746-807c-a6d5918c734e_49wlp6b8 Jun 25 18:33:06 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:06 devstack sudo[114681]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-1d52d3dc-9754-42a6-b288-7562297e4d51" returned: 0 in 0.677s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-1d52d3dc-9754-42a6-b288-7562297e4d51" released by "delete_volume" :: held 1.718s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Created reservations ['799a40aa-3a4d-4590-b15a-6036301068c3', '29b41614-bf46-49ff-9bcb-90de24eb01fe', '36a2b012-a23b-4f03-a5c7-4292e548ff78', '64d241ad-bb06-427f-96fd-5722437597b6'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:07 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:07 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:07 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bd84b26-4d62-4746-807c-a6d5918c734e_49wlp6b8" returned: 0 in 0.806s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bd84b26-4d62-4746-807c-a6d5918c734e_49wlp6b8 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:07 devstack sudo[114683]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62 1073741824" returned: 0 in 0.940s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:07 devstack sudo[114697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62 Jun 25 18:33:07 devstack sudo[114697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:07 devstack sudo[114696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bd84b26-4d62-4746-807c-a6d5918c734e_49wlp6b8 Jun 25 18:33:07 devstack sudo[114696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-165aeb30-26ef-4b6a-841b-a6d3968ae03e-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-165aeb30-26ef-4b6a-841b-a6d3968ae03e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "cinder-quobyte-165aeb30-26ef-4b6a-841b-a6d3968ae03e" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-165aeb30-26ef-4b6a-841b-a6d3968ae03e" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb13a70a-d85b-4dc7-a846-29f3e1925362]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:07 devstack sudo[114700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e Jun 25 18:33:07 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:07 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.698s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:07 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Deleted volume successfully. Jun 25 18:33:07 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0cb69b10-804a-4b1f-aa01-b15fbc687ab9 tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-1d52d3dc-9754-42a6-b288-7562297e4d51-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:08 devstack sudo[114697]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62" returned: 0 in 0.770s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.801s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-685165626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac48aa6-934c-4db6-8afb-cdb05db08334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:04Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Creating volume 8ac48aa6-934c-4db6-8afb-cdb05db08334 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:08 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:08 devstack sudo[114696]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bd84b26-4d62-4746-807c-a6d5918c734e_49wlp6b8" returned: 1 in 0.906s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bd84b26-4d62-4746-807c-a6d5918c734e_49wlp6b8' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c31fba-98b5-43f3-b13c-b25eb8c89c73]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:08 devstack sudo[114706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 1073741824 Jun 25 18:33:08 devstack sudo[114706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df527aca-23e3-4984-b720-96225e4d3d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9aa3569-52cf-486c-8596-c6c449d04d62', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eb2fc0-4daa-44ae-9e4c-6a802258eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:08 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume volume-a9aa3569-52cf-486c-8596-c6c449d04d62 (a9aa3569-52cf-486c-8596-c6c449d04d62): created successfully Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eb2fc0-4daa-44ae-9e4c-6a802258eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (14954326-b06e-4bf9-a234-931c3348f8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:08 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9900dd5a-b37a-49b4-b3e7-4969ed53a8c9 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created volume successfully. Jun 25 18:33:08 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD Jun 25 18:33:08 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:08 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e" returned: 0 in 0.884s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:08 devstack sudo[114714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e Jun 25 18:33:08 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:09 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD" returned: 0 in 0.795s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:09 devstack sudo[114706]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 1073741824" returned: 0 in 0.905s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:09 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD Jun 25 18:33:09 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:09 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 Jun 25 18:33:09 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:09 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-165aeb30-26ef-4b6a-841b-a6d3968ae03e" returned: 0 in 0.690s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-quobyte-165aeb30-26ef-4b6a-841b-a6d3968ae03e" released by "delete_volume" :: held 1.629s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Created reservations ['862c5602-108d-4956-87e0-e99860ebd117', 'f349a279-03aa-463c-bf5b-85afbf362c9b', '55ac631b-09e5-4f47-ab4e-4712683c0832', 'a5a4d81d-7560-437c-ae22-352f7bd978e7'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:09 devstack sudo[114729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:09 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:09 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD" returned: 1 in 0.748s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] 9bd84b26-4d62-4746-807c-a6d5918c734e was raw, converting to raw {{(pid=93767) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:09 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 Jun 25 18:33:09 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:09 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334" returned: 0 in 0.705s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.986s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257163247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be61cf4a-e142-4276-bcc0-5fcb5420148c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:05Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Creating volume be61cf4a-e142-4276-bcc0-5fcb5420148c {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:09 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:09 devstack sudo[114737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c 1073741824 Jun 25 18:33:09 devstack sudo[114737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f183a09-79e3-47db-9e93-70bf307122da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac48aa6-934c-4db6-8afb-cdb05db08334', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966a8919-b6fb-400e-8435-1cf18854202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:09 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 (8ac48aa6-934c-4db6-8afb-cdb05db08334): created successfully Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966a8919-b6fb-400e-8435-1cf18854202c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:09 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (257cd172-b26b-4266-bf2f-692e2a8269e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f4b5b459-148b-4cfc-bbbf-b13bb49268d8 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created volume successfully. Jun 25 18:33:10 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.780s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:10 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:10 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Deleted volume successfully. Jun 25 18:33:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c2bedfbb-b627-466b-aa13-14b59bf1922f tempest-CreateVolumesFromImageTest-524164166 None] Lock "cinder-165aeb30-26ef-4b6a-841b-a6d3968ae03e-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:10 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651" returned: 0 in 0.943s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:10 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bd84b26-4d62-4746-807c-a6d5918c734e_ux2eeof8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:33:10 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 18:33:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:10 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 1G Jun 25 18:33:10 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:10 devstack sudo[114737]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c 1073741824" returned: 0 in 1.060s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:11 devstack sudo[114748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c Jun 25 18:33:11 devstack sudo[114748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:11 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 1G" returned: 0 in 0.814s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fc2267-dbdd-43ec-9a3d-3d8e2202aa3d]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:11 devstack sudo[114753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 Jun 25 18:33:11 devstack sudo[114748]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:11 devstack sudo[114753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c" returned: 0 in 0.739s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.237s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5454130-cc4d-43be-a94d-c1cf5680940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be61cf4a-e142-4276-bcc0-5fcb5420148c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71c5024-83ff-42ac-9917-9db53d6d8feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Creating offline snapshot 2fc3c156-3822-4882-a87e-c30c4707cc25 of volume 380e778f-d14c-42ab-bd8f-bb18e6184846 {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:33:11 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume volume-be61cf4a-e142-4276-bcc0-5fcb5420148c (be61cf4a-e142-4276-bcc0-5fcb5420148c): created successfully Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71c5024-83ff-42ac-9917-9db53d6d8feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (0cca830a-f950-4895-9915-894c376935a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b430cc-40fb-4a87-bf98-1a093818d42b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:11 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e5d132ef-eeb9-402c-b21c-162d67f6ef54 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created volume successfully. Jun 25 18:33:11 devstack sudo[114756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 Jun 25 18:33:11 devstack sudo[114756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:12 devstack sudo[114753]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651" returned: 0 in 0.863s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:12 devstack sudo[114760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 Jun 25 18:33:12 devstack sudo[114760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:12 devstack sudo[114756]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846" returned: 0 in 0.866s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:12 devstack sudo[114766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 1G Jun 25 18:33:12 devstack sudo[114766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Flow 'volume_create_manager' (91d56781-bcd0-4a2a-a3fa-ee0c60cc46e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61adbf2a-7cdb-45f6-ac31-9f55f0723fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61adbf2a-7cdb-45f6-ac31-9f55f0723fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-32332156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3059a6-b621-4788-aa73-14f96c75e19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258dff1c3fda45a6929e2a3d35093cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:13Z,use_quota=True,user_id='adf65ca2a4e64436b7ba82ddffca20c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5158f9d7-b60a-44f0-9df8-4b7c4f4d9950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5158f9d7-b60a-44f0-9df8-4b7c4f4d9950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9063d7-dcca-42f4-b77c-2c528a906907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9063d7-dcca-42f4-b77c-2c528a906907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3059a6-b621-4788-aa73-14f96c75e19c', 'volume_name': 'volume-6b3059a6-b621-4788-aa73-14f96c75e19c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107a9d62-c253-4fb0-9e2b-9f032b7f820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107a9d62-c253-4fb0-9e2b-9f032b7f820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4659fc86-dccd-4e71-98e0-774bfd1b74bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:13 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Volume 6b3059a6-b621-4788-aa73-14f96c75e19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3059a6-b621-4788-aa73-14f96c75e19c', 'volume_size': 1} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:13 devstack sudo[114760]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651" returned: 1 in 0.823s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Downloaded image 9bd84b26-4d62-4746-807c-a6d5918c734e ((None, [{'url': 'file:///opt/stack/data/glance/images/9bd84b26-4d62-4746-807c-a6d5918c734e', 'metadata': {}}])) to volume 41827311-7121-48b6-942d-653408dac651 successfully. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Temporary image 9bd84b26-4d62-4746-807c-a6d5918c734e for user 1694dc483bbf4a5e85b800b6784e2e2a is deleted. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Marking volume 41827311-7121-48b6-942d-653408dac651 as bootable. {{(pid=93767) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Copying metadata from image 9bd84b26-4d62-4746-807c-a6d5918c734e to 41827311-7121-48b6-942d-653408dac651. {{(pid=93767) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Creating volume glance metadata for volume 41827311-7121-48b6-942d-653408dac651 backed by image 9bd84b26-4d62-4746-807c-a6d5918c734e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9bd84b26-4d62-4746-807c-a6d5918c734e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '04331e6fd0846b52cd5efc1ed103a281', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93767) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64483bb8-2b5c-41ab-afb5-62bd7e1c194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41827311-7121-48b6-942d-653408dac651', 'volume_size': 1, 'image_id': '9bd84b26-4d62-4746-807c-a6d5918c734e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bd84b26-4d62-4746-807c-a6d5918c734e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04331e6fd0846b52cd5efc1ed103a281', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '049d52455c3240e9827709d35788b869', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '991eb941e7e608de7df697b7e10cad4835f8017f571b8dfab63c44d6fd9a666276039930c33b3f28b41b5e0ac0e1e361e3ec2a09916842e655c766bd8b9fa71c', 'id': '9bd84b26-4d62-4746-807c-a6d5918c734e', 'created_at': datetime.datetime(2026, 6, 25, 16, 32, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 32, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bd84b26-4d62-4746-807c-a6d5918c734e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b041e19e-0321-4e5f-b65a-4320d924d478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:13 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Volume volume-41827311-7121-48b6-942d-653408dac651 (41827311-7121-48b6-942d-653408dac651): created successfully Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b041e19e-0321-4e5f-b65a-4320d924d478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Flow 'volume_create_manager' (79e6d0cb-6b71-4428-9e7c-f2be51ded8aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:13 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-6bb9aeb8-5440-4b5d-9bef-68096e01de5f tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Created volume successfully. Jun 25 18:33:13 devstack sudo[114766]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 1G" returned: 0 in 0.879s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380e778f-d14c-42ab-bd8f-bb18e6184846 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:13 devstack sudo[114776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380e778f-d14c-42ab-bd8f-bb18e6184846 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 Jun 25 18:33:13 devstack sudo[114776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:14 devstack sudo[114776]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380e778f-d14c-42ab-bd8f-bb18e6184846 -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25" returned: 0 in 0.703s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:14 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 is being set with open permissions: ugo+rw Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:14 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 Jun 25 18:33:14 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Acquiring lock "cinder-41827311-7121-48b6-942d-653408dac651-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "cinder-41827311-7121-48b6-942d-653408dac651-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Acquiring lock "cinder-quobyte-41827311-7121-48b6-942d-653408dac651" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "cinder-quobyte-41827311-7121-48b6-942d-653408dac651" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[841d5b4b-80e7-4fd9-a4ef-d90a299229f0]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:14 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 Jun 25 18:33:14 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:14 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25" returned: 0 in 0.663s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:14 devstack sudo[114792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.info Jun 25 18:33:14 devstack sudo[114792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:15 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651" returned: 0 in 0.749s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:15 devstack sudo[114796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 Jun 25 18:33:15 devstack sudo[114796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:15 devstack sudo[114792]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.info" returned: 0 in 0.677s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:15 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.info is being set with open permissions: ugo+rw Jun 25 18:33:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:15 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.info Jun 25 18:33:15 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:16 devstack sudo[114796]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651" returned: 1 in 0.747s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:16 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651 Jun 25 18:33:16 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:16 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.info" returned: 0 in 0.626s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.550s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.667s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-335367906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c4633-354c-47fa-8e16-e7bb4de3d035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:05Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Creating volume b15c4633-354c-47fa-8e16-e7bb4de3d035 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:16 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:16 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 1073741824 Jun 25 18:33:16 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:16 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c004eaae-9173-431d-9790-5c05eae020bb tempest-CinderUnicodeTest-2127034240 None] Create snapshot completed successfully Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "cinder-2fc3c156-3822-4882-a87e-c30c4707cc25-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:16 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-41827311-7121-48b6-942d-653408dac651" returned: 0 in 0.736s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-2fc3c156-3822-4882-a87e-c30c4707cc25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "cinder-quobyte-380e778f-d14c-42ab-bd8f-bb18e6184846" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "cinder-quobyte-41827311-7121-48b6-942d-653408dac651" released by "delete_volume" :: held 2.312s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-quobyte-380e778f-d14c-42ab-bd8f-bb18e6184846" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "cinder-quobyte-2fc3c156-3822-4882-a87e-c30c4707cc25" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-quobyte-2fc3c156-3822-4882-a87e-c30c4707cc25" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Deleting offline snapshot 2fc3c156-3822-4882-a87e-c30c4707cc25 of volume 380e778f-d14c-42ab-bd8f-bb18e6184846 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:33:16 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] snapshot_file for this snap is: volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[75051b31-eecf-4f6d-95f2-d8c3c02affde]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Created reservations ['3bc1a9cc-b415-473d-9cc1-2ac3370270cb', '1e4c0262-1841-44c5-8f6f-15444553d3c1', '8b5942df-b0b1-4771-8152-fa3648e233a1', 'd77da980-f337-4e72-af6d-4d16db192949'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:17 devstack sudo[114813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 Jun 25 18:33:17 devstack sudo[114813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:17 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:17 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:17 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 1073741824" returned: 0 in 0.978s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:17 devstack sudo[114817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 Jun 25 18:33:17 devstack sudo[114817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:17 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.699s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:17 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Deleted volume successfully. Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e6b60a3d-ee45-471f-9bec-3042f67a0132 tempest-VolumeAndVolumeTypeFromImageTest-1651609595 None] Lock "cinder-41827311-7121-48b6-942d-653408dac651-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:17 devstack sudo[114813]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25" returned: 0 in 0.927s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-380e778f-d14c-42ab-bd8f-bb18e6184846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0091ba-f2c6-4827-8074-6929b14ce210]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:18 devstack sudo[114817]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035" returned: 0 in 0.727s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.096s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215499515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c3308a-3ae2-4b59-b377-b4de3ac990c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bc2e3ca1c4c76bc738f3d5ecc62b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:06Z,use_quota=True,user_id='3c0237e016a74909b1204530903bdd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Creating volume 46c3308a-3ae2-4b59-b377-b4de3ac990c4 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:18 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:18 devstack sudo[114824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 Jun 25 18:33:18 devstack sudo[114824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:18 devstack sudo[114826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 1073741824 Jun 25 18:33:18 devstack sudo[114826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e318dac1-75a5-4e53-8403-91b6f920da71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15c4633-354c-47fa-8e16-e7bb4de3d035', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc8c599-2832-46ce-9232-873dc898a2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:18 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 (b15c4633-354c-47fa-8e16-e7bb4de3d035): created successfully Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc8c599-2832-46ce-9232-873dc898a2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (8f3745bd-dff9-4c74-a187-90d1887abb87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:18 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ada65eb7-3b23-4ada-8c3f-c676aa9ab5c2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created volume successfully. Jun 25 18:33:18 devstack sudo[114824]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846" returned: 0 in 0.836s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:18 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:18 devstack sudo[114834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 Jun 25 18:33:18 devstack sudo[114834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:19 devstack sudo[114826]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 1073741824" returned: 0 in 0.984s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:19 devstack sudo[114837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 Jun 25 18:33:19 devstack sudo[114837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:19 devstack sudo[114834]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25" returned: 0 in 0.881s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:19 devstack sudo[114843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25 Jun 25 18:33:19 devstack sudo[114843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:19 devstack sudo[114837]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4" returned: 0 in 0.755s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.664s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-32332156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3059a6-b621-4788-aa73-14f96c75e19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258dff1c3fda45a6929e2a3d35093cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:13Z,use_quota=True,user_id='adf65ca2a4e64436b7ba82ddffca20c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Creating volume 6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:19 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:19 devstack sudo[114846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c 1073741824 Jun 25 18:33:19 devstack sudo[114846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b5e6c1-0012-4f33-a0a2-a43e155f93a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7b5575-b7b6-43a6-9816-166fb429dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:19 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Volume volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 (46c3308a-3ae2-4b59-b377-b4de3ac990c4): created successfully Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7b5575-b7b6-43a6-9816-166fb429dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:19 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Flow 'volume_create_manager' (9f1743a1-ef06-47af-a63b-28622120fedf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:19 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-2d0844fe-bcd8-46ce-bf05-e3d4808dd8a3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created volume successfully. Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-46c3308a-3ae2-4b59-b377-b4de3ac990c4-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-46c3308a-3ae2-4b59-b377-b4de3ac990c4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-quobyte-46c3308a-3ae2-4b59-b377-b4de3ac990c4" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-46c3308a-3ae2-4b59-b377-b4de3ac990c4" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[13993317-48f0-4291-b6b2-559a6f172388]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:20 devstack sudo[114848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 Jun 25 18:33:20 devstack sudo[114848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:20 devstack sudo[114843]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846.2fc3c156-3822-4882-a87e-c30c4707cc25" returned: 0 in 0.965s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-quobyte-2fc3c156-3822-4882-a87e-c30c4707cc25" released by "_delete_snapshot" :: held 3.732s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-quobyte-380e778f-d14c-42ab-bd8f-bb18e6184846" released by "delete_snapshot" :: held 3.761s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Created reservations ['6c797be2-cff6-4b7b-aa89-29f07a1866ab', '2fc8aeff-549d-472a-88d9-213b30a799c5', 'a2276934-cee4-41ab-8adc-db8b118bcbe7', '9ff4868f-915f-4d2c-9d54-81079e31d497'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:20 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Delete snapshot completed successfully. Jun 25 18:33:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f669307e-235c-42d3-8163-a4468c0d1685 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-2fc3c156-3822-4882-a87e-c30c4707cc25-delete_snapshot" released by "delete_snapshot" :: held 3.950s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:21 devstack sudo[114846]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c 1073741824" returned: 0 in 1.162s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:21 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c Jun 25 18:33:21 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "cinder-380e778f-d14c-42ab-bd8f-bb18e6184846-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-380e778f-d14c-42ab-bd8f-bb18e6184846-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "cinder-quobyte-380e778f-d14c-42ab-bd8f-bb18e6184846" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-quobyte-380e778f-d14c-42ab-bd8f-bb18e6184846" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:21 devstack sudo[114848]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4" returned: 0 in 0.991s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77116df-23e9-4b65-9810-9cdad25736d3]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:21 devstack sudo[114862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4 Jun 25 18:33:21 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:21 devstack sudo[114864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 Jun 25 18:33:21 devstack sudo[114864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:21 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c" returned: 0 in 0.841s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4659fc86-dccd-4e71-98e0-774bfd1b74bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3059a6-b621-4788-aa73-14f96c75e19c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9621931-a724-4cef-919b-c37071a92c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:22 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Volume volume-6b3059a6-b621-4788-aa73-14f96c75e19c (6b3059a6-b621-4788-aa73-14f96c75e19c): created successfully Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9621931-a724-4cef-919b-c37071a92c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Flow 'volume_create_manager' (91d56781-bcd0-4a2a-a3fa-ee0c60cc46e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:22 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-92daaa57-5adc-4531-a888-4c99d374e839 tempest-VolumeDependencyTests-1882466855 None] Created volume successfully. Jun 25 18:33:22 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-46c3308a-3ae2-4b59-b377-b4de3ac990c4" returned: 0 in 0.770s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-46c3308a-3ae2-4b59-b377-b4de3ac990c4" released by "delete_volume" :: held 1.813s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created reservations ['c73abc5b-3992-4ae8-924e-da427f7ef8df', '6d081c05-081b-44cd-b7c9-9b9ed41ce023', 'c40471a4-ec60-4db3-9069-2d7b807c3617', 'c9427c0a-da94-440a-bd6f-e9bda5731868'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:22 devstack sudo[114872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:22 devstack sudo[114872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:22 devstack sudo[114864]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846" returned: 0 in 0.964s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:22 devstack sudo[114874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846 Jun 25 18:33:22 devstack sudo[114874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-b15c4633-354c-47fa-8e16-e7bb4de3d035-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-b15c4633-354c-47fa-8e16-e7bb4de3d035-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-quobyte-b15c4633-354c-47fa-8e16-e7bb4de3d035" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-b15c4633-354c-47fa-8e16-e7bb4de3d035" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e83697-dbe1-4cb6-9d8a-d9c58a6dca82]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:22 devstack sudo[114876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 Jun 25 18:33:22 devstack sudo[114876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:23 devstack sudo[114872]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.853s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:23 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Deleted volume successfully. Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8cc543d0-cb5c-4ed2-9f4e-913ac2a671d1 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-46c3308a-3ae2-4b59-b377-b4de3ac990c4-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Creating offline snapshot 2fc0ef3b-15af-4cee-a84b-8cef8a949315 of volume 6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56d5006-86af-41b9-8c4c-3afd80cdbd8e]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:23 devstack sudo[114874]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-380e778f-d14c-42ab-bd8f-bb18e6184846" returned: 0 in 1.052s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-quobyte-380e778f-d14c-42ab-bd8f-bb18e6184846" released by "delete_volume" :: held 2.110s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:23 devstack sudo[114881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c Jun 25 18:33:23 devstack sudo[114881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Created reservations ['f10fd430-c5ad-41e3-8a6c-bd36cf019d55', 'a347c9f5-5dcf-4a4d-a2ba-7462be9c3621', 'bdb27955-6855-4564-aa5c-b1467d766aec', '2c8a888a-928c-46c0-8432-a4a6fc0bf963'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:23 devstack sudo[114876]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035" returned: 0 in 0.944s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:23 devstack sudo[114886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035 Jun 25 18:33:23 devstack sudo[114886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:23 devstack sudo[114888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:23 devstack sudo[114888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:24 devstack sudo[114881]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c" returned: 0 in 0.889s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:24 devstack sudo[114894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 1G Jun 25 18:33:24 devstack sudo[114894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:24 devstack sudo[114886]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b15c4633-354c-47fa-8e16-e7bb4de3d035" returned: 0 in 0.718s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-b15c4633-354c-47fa-8e16-e7bb4de3d035" released by "delete_volume" :: held 1.715s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created reservations ['89d06cef-77b2-485e-8bf1-61a9e1f95d28', '85c3a214-51c8-4790-9e43-e2bce776f02f', '0ddbc29e-04c1-4ea7-a0bf-ea5d45343f54', '81c671d0-ec7c-4d4d-887d-757d010cd747'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:24 devstack sudo[114888]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.782s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:24 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Deleted volume successfully. Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9d59d7e4-51d2-4238-b1ea-85554ddfde10 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-380e778f-d14c-42ab-bd8f-bb18e6184846-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:24 devstack sudo[114897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:24 devstack sudo[114897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "cinder-6eeca519-a871-4aac-89e6-00de486a7c09-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-6eeca519-a871-4aac-89e6-00de486a7c09-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "cinder-quobyte-6eeca519-a871-4aac-89e6-00de486a7c09" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-quobyte-6eeca519-a871-4aac-89e6-00de486a7c09" acquired by "delete_volume" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a08617e-f201-4431-a799-384bb7435e23]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-be61cf4a-e142-4276-bcc0-5fcb5420148c-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-be61cf4a-e142-4276-bcc0-5fcb5420148c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-quobyte-be61cf4a-e142-4276-bcc0-5fcb5420148c" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-be61cf4a-e142-4276-bcc0-5fcb5420148c" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:24 devstack sudo[114899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09 Jun 25 18:33:24 devstack sudo[114899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b800730-bdfc-4fae-8b23-9f2aa6e6f813]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:25 devstack sudo[114904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c Jun 25 18:33:25 devstack sudo[114904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:25 devstack sudo[114894]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 1G" returned: 0 in 1.079s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b3059a6-b621-4788-aa73-14f96c75e19c -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:25 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b3059a6-b621-4788-aa73-14f96c75e19c -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 Jun 25 18:33:25 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:25 devstack sudo[114897]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.947s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:25 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:25 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Deleted volume successfully. Jun 25 18:33:25 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-d8d49e8c-f611-450f-9dbc-e6bcc73aba1a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-b15c4633-354c-47fa-8e16-e7bb4de3d035-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:25 devstack sudo[114899]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09" returned: 0 in 1.061s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:25 devstack sudo[114918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09 Jun 25 18:33:25 devstack sudo[114918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:25 devstack sudo[114904]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c" returned: 0 in 0.940s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:25 devstack sudo[114920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c Jun 25 18:33:25 devstack sudo[114920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:26 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b3059a6-b621-4788-aa73-14f96c75e19c -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315" returned: 0 in 0.869s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:26 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 is being set with open permissions: ugo+rw Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:26 devstack sudo[114925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 Jun 25 18:33:26 devstack sudo[114925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Flow 'volume_create_manager' (52d16f02-428f-445e-b2bb-e6f485e73f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339b41eb-1356-486e-bd04-e941fb170a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339b41eb-1356-486e-bd04-e941fb170a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95602830-ac52-4f0e-a028-dbf8d16736e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6649c8ff60d943f48fbb5e40ccb47504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:26Z,use_quota=True,user_id='f2e1f461ef524a4e9673c02d0092cb98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5d2ea5-a716-4b16-9255-ff40ee7399ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5d2ea5-a716-4b16-9255-ff40ee7399ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd100015-ef2b-44d6-9635-54d632668b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.image.glance [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Creating Keystone auth plugin from conf {{(pid=93767) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:33:26 devstack sudo[114920]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-be61cf4a-e142-4276-bcc0-5fcb5420148c" returned: 0 in 0.758s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-be61cf4a-e142-4276-bcc0-5fcb5420148c" released by "delete_volume" :: held 1.754s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:26 devstack sudo[114918]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6eeca519-a871-4aac-89e6-00de486a7c09" returned: 0 in 0.842s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-quobyte-6eeca519-a871-4aac-89e6-00de486a7c09" released by "delete_volume" :: held 1.961s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created reservations ['f04ef706-291f-4e97-8634-c38eb78bd0eb', '0b06393c-5850-49da-83e8-2f14d0b56a3f', 'a37ff5e7-8a29-4d06-9c74-0cd77def4f97', 'd5d026ed-5e5e-47ce-9b88-4e4ebde97f27'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Created reservations ['93cdd518-2d53-4857-9ab4-083f4a08bb99', 'a4507f5c-d68f-471e-9cb6-05cefeafb8b2', '88d59c31-c385-42bd-b8c5-b0f1f8b35d95', 'ddfc8b09-9abf-4968-b0c5-e335d6b76acf'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:26 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:26 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd100015-ef2b-44d6-9635-54d632668b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95602830-ac52-4f0e-a028-dbf8d16736e4', 'volume_name': 'volume-95602830-ac52-4f0e-a028-dbf8d16736e4', 'volume_size': 1, 'image_id': '2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88e85d4b4c22446304e8729d41fab26c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6649c8ff60d943f48fbb5e40ccb47504', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a90a98fe94090b01cc245f616dd21ba573411a86d411e1378234e23c33c439dadec9aeecf358e8943b6ebdd0aebb4200c86e55a98b724aa459ee9baad04a7ef', 'id': '2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'created_at': datetime.datetime(2026, 6, 25, 16, 33, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 33, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2647ac03-3034-4a72-b611-eeb0e8fc28fe/file', 'properties': {}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ba9f69-4cfc-4bca-bcc7-cb33522babbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ba9f69-4cfc-4bca-bcc7-cb33522babbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:26 devstack sudo[114925]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94644aae-e181-49a4-a6e9-60aad4ff8abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:26 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Volume 95602830-ac52-4f0e-a028-dbf8d16736e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95602830-ac52-4f0e-a028-dbf8d16736e4', 'volume_size': 1, 'image_id': '2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88e85d4b4c22446304e8729d41fab26c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6649c8ff60d943f48fbb5e40ccb47504', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a90a98fe94090b01cc245f616dd21ba573411a86d411e1378234e23c33c439dadec9aeecf358e8943b6ebdd0aebb4200c86e55a98b724aa459ee9baad04a7ef', 'id': '2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'created_at': datetime.datetime(2026, 6, 25, 16, 33, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 33, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2647ac03-3034-4a72-b611-eeb0e8fc28fe/file', 'properties': {}}, 'image_service': } Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Trying to clone 95602830-ac52-4f0e-a028-dbf8d16736e4 from image 2647ac03-3034-4a72-b611-eeb0e8fc28fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'metadata': {}}]). {{(pid=93767) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:33:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315" returned: 0 in 0.836s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:27 devstack sudo[114932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:27 devstack sudo[114932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:27 devstack sudo[114934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.info Jun 25 18:33:27 devstack sudo[114934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:33:27 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Image download 0.00 MB at 0.00 MB/s Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-8ac48aa6-934c-4db6-8afb-cdb05db08334-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57637bb-e623-41e4-b475-5b63f258bc01]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-8ac48aa6-934c-4db6-8afb-cdb05db08334-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-quobyte-8ac48aa6-934c-4db6-8afb-cdb05db08334" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-8ac48aa6-934c-4db6-8afb-cdb05db08334" acquired by "delete_volume" :: waited 0.039s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:27 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD Jun 25 18:33:27 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fbbb76-a86b-465f-9bd1-f57aecebf1da]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:27 devstack sudo[114938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 Jun 25 18:33:27 devstack sudo[114938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:28 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.171s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:28 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Deleted volume successfully. Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-eb08f4ee-6535-4d52-bf32-4d4b964e06a2 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-be61cf4a-e142-4276-bcc0-5fcb5420148c-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:28 devstack sudo[114932]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.193s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:28 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Deleted volume successfully. Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9e28167a-f58f-4eb2-9cca-66bc0b3a9239 tempest-CinderUnicodeTest-2127034240 None] Lock "cinder-6eeca519-a871-4aac-89e6-00de486a7c09-delete_volume" released by "delete_volume" :: held 3.629s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:28 devstack sudo[114934]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.info" returned: 0 in 1.199s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:28 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.info is being set with open permissions: ugo+rw Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:28 devstack sudo[114944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.info Jun 25 18:33:28 devstack sudo[114944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:28 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD" returned: 0 in 1.238s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:28 devstack sudo[114950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD Jun 25 18:33:28 devstack sudo[114950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:28 devstack sudo[114938]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334" returned: 0 in 1.160s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:28 devstack sudo[114954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334 Jun 25 18:33:28 devstack sudo[114954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:29 devstack sudo[114944]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.info" returned: 0 in 0.967s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.012s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e90cdd35-722e-44b4-a136-db009f9dc255 tempest-VolumeDependencyTests-1882466855 None] Create snapshot completed successfully Jun 25 18:33:29 devstack sudo[114950]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD" returned: 1 in 0.867s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Temporary image 2647ac03-3034-4a72-b611-eeb0e8fc28fe is fetched for user f2e1f461ef524a4e9673c02d0092cb98. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3757fb3-1e23-4f22-aad3-cb01ceb75a66]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:29 devstack sudo[114954]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8ac48aa6-934c-4db6-8afb-cdb05db08334" returned: 0 in 0.845s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-8ac48aa6-934c-4db6-8afb-cdb05db08334" released by "delete_volume" :: held 2.119s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:29 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD Jun 25 18:33:29 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created reservations ['4bdef757-7b9a-4d62-a94b-7b07a6d34b42', '8a52e832-10cf-4157-a9c3-e8e860516edc', '336b5762-e3b2-414e-b042-5b705e24be92', '97813b01-31c9-4577-a224-3c2204efbbbd'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:29 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:29 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:30 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD" returned: 0 in 0.869s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Flow 'volume_create_manager' (b6c0ce12-79a3-4e46-9928-36c92a84f22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8880b5f0-1155-4dc7-973a-3b9471b7c71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8880b5f0-1155-4dc7-973a-3b9471b7c71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1008935817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7d04a4-2662-4358-bb80-2109e455b55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258dff1c3fda45a6929e2a3d35093cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2fc0ef3b-15af-4cee-a84b-8cef8a949315,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:30Z,use_quota=True,user_id='adf65ca2a4e64436b7ba82ddffca20c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d225dd-c5d2-45e0-b384-fed2ad2e0a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d225dd-c5d2-45e0-b384-fed2ad2e0a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406bb419-9e9a-45c1-bfbd-b1a065ad750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406bb419-9e9a-45c1-bfbd-b1a065ad750c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e7d04a4-2662-4358-bb80-2109e455b55f', 'volume_name': 'volume-8e7d04a4-2662-4358-bb80-2109e455b55f', 'volume_size': 1, 'snapshot_id': '2fc0ef3b-15af-4cee-a84b-8cef8a949315'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8e9f6f-e619-4da9-a2a7-f7002f0f35be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8e9f6f-e619-4da9-a2a7-f7002f0f35be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d5fc0a-74cd-4cd5-aa72-52d64d911836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:30 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Volume 8e7d04a4-2662-4358-bb80-2109e455b55f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e7d04a4-2662-4358-bb80-2109e455b55f', 'volume_size': 1, 'snapshot_id': '2fc0ef3b-15af-4cee-a84b-8cef8a949315'} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "cinder-quobyte-2fc0ef3b-15af-4cee-a84b-8cef8a949315-8e7d04a4-2662-4358-bb80-2109e455b55f" by "_create_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-2fc0ef3b-15af-4cee-a84b-8cef8a949315-8e7d04a4-2662-4358-bb80-2109e455b55f" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Creating volume 8e7d04a4-2662-4358-bb80-2109e455b55f from snapshot 2fc0ef3b-15af-4cee-a84b-8cef8a949315 {{(pid=93767) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:33:30 devstack sudo[114967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD Jun 25 18:33:30 devstack sudo[114967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "cinder-quobyte-8e7d04a4-2662-4358-bb80-2109e455b55f" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-8e7d04a4-2662-4358-bb80-2109e455b55f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] snapshot: 2fc0ef3b-15af-4cee-a84b-8cef8a949315, volume: 8e7d04a4-2662-4358-bb80-2109e455b55f, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c751f32b-d635-4444-ad35-a163b80a819b]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:30 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-a9aa3569-52cf-486c-8596-c6c449d04d62-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.876s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:30 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Deleted volume successfully. Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-a9aa3569-52cf-486c-8596-c6c449d04d62-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c1d8ee98-9804-4534-972b-5251b70c78c4 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-8ac48aa6-934c-4db6-8afb-cdb05db08334-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-quobyte-a9aa3569-52cf-486c-8596-c6c449d04d62" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-a9aa3569-52cf-486c-8596-c6c449d04d62" acquired by "delete_volume" :: waited 0.022s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaa2136-57ec-4e2b-9912-2e36215f8bb5]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:30 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:30 devstack sudo[114970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 Jun 25 18:33:30 devstack sudo[114970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:30 devstack sudo[114971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62 Jun 25 18:33:30 devstack sudo[114971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:31 devstack sudo[114967]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD" returned: 1 in 1.000s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:31 devstack sudo[114970]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315" returned: 0 in 1.042s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b3059a6-b621-4788-aa73-14f96c75e19c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[64555c7c-5d41-4bd5-a828-d69bba62bcd9]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:31 devstack sudo[114982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c Jun 25 18:33:31 devstack sudo[114982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:31 devstack sudo[114971]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62" returned: 0 in 1.011s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:31 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:31 devstack sudo[114985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62 Jun 25 18:33:31 devstack sudo[114985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:32 devstack sudo[114985]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:32 devstack sudo[114982]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-a9aa3569-52cf-486c-8596-c6c449d04d62" returned: 0 in 0.741s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c" returned: 0 in 0.936s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-a9aa3569-52cf-486c-8596-c6c449d04d62" released by "delete_volume" :: held 1.849s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:32 devstack sudo[114991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f Jun 25 18:33:32 devstack sudo[114991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created reservations ['12a50729-4460-4294-a85a-d84c3a2767ec', '3d2bd800-fabc-49ae-9b87-5b2aa027e135', '42616c99-779d-41f5-965d-a5289615cd3e', '5e185bdd-0362-4c38-ba51-672f242faa5c'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:32 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:32 devstack sudo[114993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:32 devstack sudo[114993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-8f3ea086-2533-453b-a840-1e8c32ec50c9-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-8f3ea086-2533-453b-a840-1e8c32ec50c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-quobyte-7498206a-c69d-4a45-8357-9e4e6b086e6f" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-7498206a-c69d-4a45-8357-9e4e6b086e6f" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-quobyte-8f3ea086-2533-453b-a840-1e8c32ec50c9" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-8f3ea086-2533-453b-a840-1e8c32ec50c9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Deleting offline snapshot 8f3ea086-2533-453b-a840-1e8c32ec50c9 of volume 7498206a-c69d-4a45-8357-9e4e6b086e6f {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] snapshot_file for this snap is: volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[3343f60d-b811-4b41-a51b-92d151da1d08]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:33 devstack sudo[114996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 Jun 25 18:33:33 devstack sudo[114996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:33 devstack sudo[114993]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.239s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:33 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:33 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Deleted volume successfully. Jun 25 18:33:34 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-e7269424-5410-46ea-9250-7c9fc702224a tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-a9aa3569-52cf-486c-8596-c6c449d04d62-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:35 devstack sudo[114996]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9" returned: 0 in 2.376s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:35 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7498206a-c69d-4a45-8357-9e4e6b086e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:33:35 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[7777be24-be92-4647-9beb-090e7ef7d8d6]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:35 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:35 devstack sudo[115013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f Jun 25 18:33:35 devstack sudo[115013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:37 devstack sudo[115013]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f" returned: 0 in 2.041s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:37 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:37 devstack sudo[115018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 Jun 25 18:33:37 devstack sudo[115018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:38 devstack sudo[114991]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f" returned: 0 in 5.795s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:38 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf444cc-6fa2-4659-88f2-e909df1c518f]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:38 devstack sudo[115021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c Jun 25 18:33:38 devstack sudo[115021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:38 devstack sudo[115018]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9" returned: 0 in 1.201s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:38 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:38 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9 Jun 25 18:33:38 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:39 devstack sudo[115021]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c" returned: 0 in 1.049s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:39 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:33:39 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Converted 1024.00 MB image at 176.56 MB/s Jun 25 18:33:39 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f is being set with open permissions: ugo+rw Jun 25 18:33:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:39 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f Jun 25 18:33:39 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:39 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:39 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f.8f3ea086-2533-453b-a840-1e8c32ec50c9" returned: 0 in 0.660s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-8f3ea086-2533-453b-a840-1e8c32ec50c9" released by "_delete_snapshot" :: held 6.522s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-7498206a-c69d-4a45-8357-9e4e6b086e6f" released by "delete_snapshot" :: held 6.568s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:39 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created reservations ['566509ab-0a13-44e3-b84d-232743de65b8', '0de0ded0-f48d-460c-8137-ce0ae64a7da6', 'e709215a-239f-4b08-9e26-9b412435b240', '0bda92b2-f205-4cee-9ea8-9ecfa0a2e0e1'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:39 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Delete snapshot completed successfully. Jun 25 18:33:39 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0fe705b6-8e57-4bc3-9fd3-1a7fe3e73ad3 tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-8f3ea086-2533-453b-a840-1e8c32ec50c9-delete_snapshot" released by "delete_snapshot" :: held 6.885s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:40 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f" returned: 0 in 0.827s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-8e7d04a4-2662-4358-bb80-2109e455b55f" released by "_copy_volume_from_snapshot" :: held 9.797s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-2fc0ef3b-15af-4cee-a84b-8cef8a949315-8e7d04a4-2662-4358-bb80-2109e455b55f" released by "_create_volume_from_snapshot" :: held 9.844s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.865s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.984s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95602830-ac52-4f0e-a028-dbf8d16736e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6649c8ff60d943f48fbb5e40ccb47504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:26Z,use_quota=True,user_id='f2e1f461ef524a4e9673c02d0092cb98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Creating volume 95602830-ac52-4f0e-a028-dbf8d16736e4 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:40 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:40 devstack sudo[115036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 1073741824 Jun 25 18:33:40 devstack sudo[115036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d5fc0a-74cd-4cd5-aa72-52d64d911836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e7d04a4-2662-4358-bb80-2109e455b55f', 'volume_size': 1, 'snapshot_id': '2fc0ef3b-15af-4cee-a84b-8cef8a949315'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0dbee42-ad2a-4d72-8bf9-8dfd2532ed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:40 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Volume volume-8e7d04a4-2662-4358-bb80-2109e455b55f (8e7d04a4-2662-4358-bb80-2109e455b55f): created successfully Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0dbee42-ad2a-4d72-8bf9-8dfd2532ed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Flow 'volume_create_manager' (b6c0ce12-79a3-4e46-9928-36c92a84f22e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:40 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-af522a9f-ee26-4b60-a130-915537c2f134 tempest-VolumeDependencyTests-1882466855 None] Created volume successfully. Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:40 devstack sudo[115038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:40 devstack sudo[115038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-7498206a-c69d-4a45-8357-9e4e6b086e6f-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-7498206a-c69d-4a45-8357-9e4e6b086e6f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "cinder-quobyte-7498206a-c69d-4a45-8357-9e4e6b086e6f" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-7498206a-c69d-4a45-8357-9e4e6b086e6f" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[205d6b96-41c1-4755-8e1e-0cdd2399d86d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:41 devstack sudo[115040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f Jun 25 18:33:41 devstack sudo[115040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:41 devstack sudo[115038]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.826s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "cinder-2fc0ef3b-15af-4cee-a84b-8cef8a949315-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-2fc0ef3b-15af-4cee-a84b-8cef8a949315-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "cinder-quobyte-6b3059a6-b621-4788-aa73-14f96c75e19c" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-6b3059a6-b621-4788-aa73-14f96c75e19c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "cinder-quobyte-2fc0ef3b-15af-4cee-a84b-8cef8a949315" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-2fc0ef3b-15af-4cee-a84b-8cef8a949315" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Deleting offline snapshot 2fc0ef3b-15af-4cee-a84b-8cef8a949315 of volume 6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] snapshot_file for this snap is: volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[97511173-0b80-4cc4-8173-b10874d77366]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:41 devstack sudo[115036]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 1073741824" returned: 0 in 1.227s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:41 devstack sudo[115047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 Jun 25 18:33:41 devstack sudo[115047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:41 devstack sudo[115046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 Jun 25 18:33:41 devstack sudo[115046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:42 devstack sudo[115040]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f" returned: 0 in 1.104s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:42 devstack sudo[115053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f Jun 25 18:33:42 devstack sudo[115053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:42 devstack sudo[115047]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4" returned: 0 in 0.898s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Attempting download of 2647ac03-3034-4a72-b611-eeb0e8fc28fe ((None, [{'url': 'file:///opt/stack/data/glance/images/2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'metadata': {}}])) to volume 95602830-ac52-4f0e-a028-dbf8d16736e4. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:33:42 devstack sudo[115046]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315" returned: 0 in 1.075s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b3059a6-b621-4788-aa73-14f96c75e19c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8a5a1-c1d0-425c-85d7-f2dce34662e3]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2647ac03-3034-4a72-b611-eeb0e8fc28fe_xt6g9ld_ {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[313f6578-1338-4830-a004-593c4985f92d]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:42 devstack sudo[115061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c Jun 25 18:33:42 devstack sudo[115061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:42 devstack sudo[115060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2647ac03-3034-4a72-b611-eeb0e8fc28fe_xt6g9ld_ Jun 25 18:33:42 devstack sudo[115060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:42 devstack sudo[115053]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:42 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-7498206a-c69d-4a45-8357-9e4e6b086e6f" returned: 0 in 0.964s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-quobyte-7498206a-c69d-4a45-8357-9e4e6b086e6f" released by "delete_volume" :: held 2.155s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=166,cinder:SELECT=129,cinder:INSERT=44,cinder:DELETE=16 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Created reservations ['5ab71e1f-333c-4940-b9f6-b79934aaad44', '8390d769-2565-473e-a6ce-31d711f1cfce', '3e1808dc-bc87-470d-af51-df7fa53ab7bb', '9f2396c9-04c8-4b59-a86a-1cbd2e1066a4'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:43 devstack sudo[115066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:43 devstack sudo[115066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:43 devstack sudo[115061]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c" returned: 0 in 1.016s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:43 devstack sudo[115060]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2647ac03-3034-4a72-b611-eeb0e8fc28fe_xt6g9ld_" returned: 0 in 1.063s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2647ac03-3034-4a72-b611-eeb0e8fc28fe_xt6g9ld_ {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:43 devstack sudo[115073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 Jun 25 18:33:43 devstack sudo[115073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:43 devstack sudo[115075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2647ac03-3034-4a72-b611-eeb0e8fc28fe_xt6g9ld_ Jun 25 18:33:43 devstack sudo[115075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:43 devstack sudo[115066]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.749s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:43 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Deleted volume successfully. Jun 25 18:33:43 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=137,cinder:UPDATE=187,cinder:INSERT=50,cinder:DELETE=17 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:33:44 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-07c46e01-fcdb-44b1-8ac2-10081c8df6bf tempest-CreateVolumesFromSnapshotTest-1051896121 None] Lock "cinder-7498206a-c69d-4a45-8357-9e4e6b086e6f-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:44 devstack sudo[115073]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315" returned: 0 in 1.052s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:44 devstack sudo[115084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315 Jun 25 18:33:44 devstack sudo[115084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:44 devstack sudo[115075]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2647ac03-3034-4a72-b611-eeb0e8fc28fe_xt6g9ld_" returned: 1 in 1.058s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2647ac03-3034-4a72-b611-eeb0e8fc28fe_xt6g9ld_' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:44 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8980b8d-45d4-477c-8221-50d7443092b9]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:44 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:44 devstack sudo[115086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD Jun 25 18:33:44 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:45 devstack sudo[115084]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c.2fc0ef3b-15af-4cee-a84b-8cef8a949315" returned: 0 in 0.947s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:45 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD" returned: 0 in 0.954s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:45 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-2fc0ef3b-15af-4cee-a84b-8cef8a949315" released by "_delete_snapshot" :: held 4.240s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-6b3059a6-b621-4788-aa73-14f96c75e19c" released by "delete_snapshot" :: held 4.273s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:45 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Created reservations ['57a55ea1-b2e1-4c60-ad1d-4e600a150921', '0cd51b80-0f01-4285-b2df-a2dc4e04ef79', 'dbdbf697-9013-497c-926c-5c6d346fedad', '562c415d-6375-438f-ad6f-03c3c04f25ed'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:45 devstack sudo[115091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD Jun 25 18:33:45 devstack sudo[115091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:45 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Delete snapshot completed successfully. Jun 25 18:33:45 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-5668c31a-b007-44b0-a702-baffe87b881d tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-2fc0ef3b-15af-4cee-a84b-8cef8a949315-delete_snapshot" released by "delete_snapshot" :: held 4.468s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:46 devstack sudo[115091]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD" returned: 1 in 0.954s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:46 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] 2647ac03-3034-4a72-b611-eeb0e8fc28fe was raw, converting to raw {{(pid=93767) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:33:46 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:46 devstack sudo[115096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 Jun 25 18:33:46 devstack sudo[115096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:46 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "cinder-6b3059a6-b621-4788-aa73-14f96c75e19c-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:46 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-6b3059a6-b621-4788-aa73-14f96c75e19c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:46 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "cinder-quobyte-6b3059a6-b621-4788-aa73-14f96c75e19c" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:46 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-6b3059a6-b621-4788-aa73-14f96c75e19c" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:47 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e600ba2-13db-47c1-99f0-38805fc42b73]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:47 devstack sudo[115098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c Jun 25 18:33:47 devstack sudo[115098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:47 devstack sudo[115096]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4" returned: 0 in 1.128s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:47 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2647ac03-3034-4a72-b611-eeb0e8fc28fe_329qk9atdevstack@QuobyteHD, size 0.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:33:47 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 18:33:47 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:47 devstack sudo[115103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 1G Jun 25 18:33:47 devstack sudo[115103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:48 devstack sudo[115098]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c" returned: 0 in 1.218s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:48 devstack sudo[115108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c Jun 25 18:33:48 devstack sudo[115108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (43775c99-a28e-4375-b7f7-0fd6fd393b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc14416c-fd5b-4f63-8b61-39019d9777e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc14416c-fd5b-4f63-8b61-39019d9777e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1140630695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23b41b7-e4b7-4e1a-b115-b9da97915089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:48Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d79ef6-a4a1-4900-b345-36dcd00c4401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d79ef6-a4a1-4900-b345-36dcd00c4401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3886b5ea-d990-4269-a54d-fc55a93f0882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3886b5ea-d990-4269-a54d-fc55a93f0882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23b41b7-e4b7-4e1a-b115-b9da97915089', 'volume_name': 'volume-b23b41b7-e4b7-4e1a-b115-b9da97915089', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4af594-10ab-4c33-a345-e20ebc145a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4af594-10ab-4c33-a345-e20ebc145a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c19df4-395b-478e-86c0-59777679220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:48 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume b23b41b7-e4b7-4e1a-b115-b9da97915089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23b41b7-e4b7-4e1a-b115-b9da97915089', 'volume_size': 1} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1140630695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23b41b7-e4b7-4e1a-b115-b9da97915089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:48Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Creating volume b23b41b7-e4b7-4e1a-b115-b9da97915089 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:48 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:48 devstack sudo[115110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 1073741824 Jun 25 18:33:48 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:48 devstack sudo[115103]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 1G" returned: 0 in 0.952s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[f162e05f-8e7a-4c36-a8a0-4e82a8259098]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:48 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:48 devstack sudo[115116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 Jun 25 18:33:48 devstack sudo[115116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:49 devstack sudo[115108]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-6b3059a6-b621-4788-aa73-14f96c75e19c" returned: 0 in 0.773s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-6b3059a6-b621-4788-aa73-14f96c75e19c" released by "delete_volume" :: held 2.059s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Created reservations ['2e5d4c3b-86c0-4d6a-b2e9-962934043b53', 'c68dcd14-6beb-4216-adbf-39e59bb50370', '80d6e607-5d86-4d61-953e-bd9c112dc422', 'e3e070c4-059b-4c54-b9df-012f27652cc5'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:49 devstack sudo[115122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:49 devstack sudo[115122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:49 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 1073741824" returned: 0 in 1.163s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:49 devstack sudo[115124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 Jun 25 18:33:49 devstack sudo[115124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:49 devstack sudo[115116]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4" returned: 0 in 1.062s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:49 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:50 devstack sudo[115128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 Jun 25 18:33:50 devstack sudo[115128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:50 devstack sudo[115122]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.823s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:50 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Deleted volume successfully. Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-1a7ffcc9-8be7-496a-af53-4ea508f6da54 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-6b3059a6-b621-4788-aa73-14f96c75e19c-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "cinder-8e7d04a4-2662-4358-bb80-2109e455b55f-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-8e7d04a4-2662-4358-bb80-2109e455b55f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "cinder-quobyte-8e7d04a4-2662-4358-bb80-2109e455b55f" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-8e7d04a4-2662-4358-bb80-2109e455b55f" acquired by "delete_volume" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:50 devstack sudo[115124]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089" returned: 0 in 0.937s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[483cff5d-95b1-4d7d-b858-e14433be78c0]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c19df4-395b-478e-86c0-59777679220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23b41b7-e4b7-4e1a-b115-b9da97915089', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1962182d-2d16-429f-a0b8-a8c31de7e5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:50 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 (b23b41b7-e4b7-4e1a-b115-b9da97915089): created successfully Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1962182d-2d16-429f-a0b8-a8c31de7e5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (43775c99-a28e-4375-b7f7-0fd6fd393b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:50 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1081b0ee-76d5-4450-be26-15b209543883 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created volume successfully. Jun 25 18:33:50 devstack sudo[115132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f Jun 25 18:33:50 devstack sudo[115132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:50 devstack sudo[115128]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4" returned: 1 in 0.984s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Downloaded image 2647ac03-3034-4a72-b611-eeb0e8fc28fe ((None, [{'url': 'file:///opt/stack/data/glance/images/2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'metadata': {}}])) to volume 95602830-ac52-4f0e-a028-dbf8d16736e4 successfully. {{(pid=93767) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Temporary image 2647ac03-3034-4a72-b611-eeb0e8fc28fe for user f2e1f461ef524a4e9673c02d0092cb98 is deleted. {{(pid=93767) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.volume_utils [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Marking volume 95602830-ac52-4f0e-a028-dbf8d16736e4 as bootable. {{(pid=93767) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Copying metadata from image 2647ac03-3034-4a72-b611-eeb0e8fc28fe to 95602830-ac52-4f0e-a028-dbf8d16736e4. {{(pid=93767) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Creating volume glance metadata for volume 95602830-ac52-4f0e-a028-dbf8d16736e4 backed by image 2647ac03-3034-4a72-b611-eeb0e8fc28fe with: {'image_id': '2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '88e85d4b4c22446304e8729d41fab26c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93767) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94644aae-e181-49a4-a6e9-60aad4ff8abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95602830-ac52-4f0e-a028-dbf8d16736e4', 'volume_size': 1, 'image_id': '2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88e85d4b4c22446304e8729d41fab26c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6649c8ff60d943f48fbb5e40ccb47504', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a90a98fe94090b01cc245f616dd21ba573411a86d411e1378234e23c33c439dadec9aeecf358e8943b6ebdd0aebb4200c86e55a98b724aa459ee9baad04a7ef', 'id': '2647ac03-3034-4a72-b611-eeb0e8fc28fe', 'created_at': datetime.datetime(2026, 6, 25, 16, 33, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 33, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2647ac03-3034-4a72-b611-eeb0e8fc28fe/file', 'properties': {}}, 'image_service': }' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:50 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa19e2f-3e52-4ca9-a05f-48e71fb4a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:50 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Volume volume-95602830-ac52-4f0e-a028-dbf8d16736e4 (95602830-ac52-4f0e-a028-dbf8d16736e4): created successfully Jun 25 18:33:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa19e2f-3e52-4ca9-a05f-48e71fb4a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:51 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Flow 'volume_create_manager' (52d16f02-428f-445e-b2bb-e6f485e73f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:51 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a8e4133a-ddd7-4055-b892-d8fa88cdcb64 tempest-VolumeImageDependencyTests-1620006009 None] Created volume successfully. Jun 25 18:33:51 devstack sudo[115132]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f" returned: 0 in 0.968s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:51 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:51 devstack sudo[115140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f Jun 25 18:33:51 devstack sudo[115140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (2f452c03-fc38-40f4-8d35-0ce6f337257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23990aa3-d04e-4665-a700-f78b4801ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23990aa3-d04e-4665-a700-f78b4801ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1409228394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c18211-0aff-43d3-9663-f81f981dd814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:52Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5667cb09-a304-486e-882a-b23ca11167e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5667cb09-a304-486e-882a-b23ca11167e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173181eb-6630-4ad1-a5c2-457794a5f502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173181eb-6630-4ad1-a5c2-457794a5f502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c18211-0aff-43d3-9663-f81f981dd814', 'volume_name': 'volume-40c18211-0aff-43d3-9663-f81f981dd814', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a06ee9-2ea9-4288-9765-677d1cef9c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a06ee9-2ea9-4288-9765-677d1cef9c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0cfb73-c189-42da-a5f6-8309791e95cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume 40c18211-0aff-43d3-9663-f81f981dd814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c18211-0aff-43d3-9663-f81f981dd814', 'volume_size': 1} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1409228394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c18211-0aff-43d3-9663-f81f981dd814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:52Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Creating volume 40c18211-0aff-43d3-9663-f81f981dd814 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:52 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:52 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814 1073741824 Jun 25 18:33:52 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Acquiring lock "cinder-95602830-ac52-4f0e-a028-dbf8d16736e4-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Lock "cinder-95602830-ac52-4f0e-a028-dbf8d16736e4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Acquiring lock "cinder-quobyte-95602830-ac52-4f0e-a028-dbf8d16736e4" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Lock "cinder-quobyte-95602830-ac52-4f0e-a028-dbf8d16736e4" acquired by "delete_volume" :: waited 0.030s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:33:52 devstack sudo[115140]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffea2ec1-311c-4e50-a514-81cd797a13dd]: (4, 'raw') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8e7d04a4-2662-4358-bb80-2109e455b55f" returned: 0 in 1.097s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-quobyte-8e7d04a4-2662-4358-bb80-2109e455b55f" released by "delete_volume" :: held 2.129s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:52 devstack sudo[115145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (7d394641-74d1-4ec6-be0d-eac188277579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:52 devstack sudo[115145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff7702d-428b-4b31-b182-0539098390d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Created reservations ['aa060d74-8126-43fc-9f7b-70a62fa2807a', 'ad41bc5b-86b8-452c-80da-763dc22948f4', '74b8d6ff-bb45-4d44-aaf1-25aee5fee6fd', 'f43dd9de-b537-4041-bc72-a38f091dfc94'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff7702d-428b-4b31-b182-0539098390d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194693845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665d798f-f972-4929-94da-a66fa75aa973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:53Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde112d8-3d34-4b78-a448-85e49ad57dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde112d8-3d34-4b78-a448-85e49ad57dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ce67ef-65c8-4514-88e4-c49069d0a4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ce67ef-65c8-4514-88e4-c49069d0a4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665d798f-f972-4929-94da-a66fa75aa973', 'volume_name': 'volume-665d798f-f972-4929-94da-a66fa75aa973', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358debb6-343a-4451-a2b7-118a73115a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358debb6-343a-4451-a2b7-118a73115a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc87d80f-3e37-42b2-aa3b-01f0329049e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:52 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume 665d798f-f972-4929-94da-a66fa75aa973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665d798f-f972-4929-94da-a66fa75aa973', 'volume_size': 1} Jun 25 18:33:52 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:53 devstack sudo[115148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:53 devstack sudo[115148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (02138371-0e93-40fd-8924-14284f648058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08c1c6e-44bb-4123-a918-b424087b1046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08c1c6e-44bb-4123-a918-b424087b1046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-417698576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbce442-8766-4652-b002-fc2e8dda8f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:53Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309159d1-cec2-4321-9409-32f1323f71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309159d1-cec2-4321-9409-32f1323f71b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00627365-d49c-4fd9-a31d-46d3cb5e5276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00627365-d49c-4fd9-a31d-46d3cb5e5276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffbce442-8766-4652-b002-fc2e8dda8f16', 'volume_name': 'volume-ffbce442-8766-4652-b002-fc2e8dda8f16', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72ee2e3-fa98-489a-a7fe-11255d5811fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72ee2e3-fa98-489a-a7fe-11255d5811fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18533ee4-86bd-41b7-a565-c79ae3137050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:53 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume ffbce442-8766-4652-b002-fc2e8dda8f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffbce442-8766-4652-b002-fc2e8dda8f16', 'volume_size': 1} Jun 25 18:33:53 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:54 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814 1073741824" returned: 0 in 1.868s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:54 devstack sudo[115156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814 Jun 25 18:33:54 devstack sudo[115156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:54 devstack sudo[115145]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4" returned: 0 in 1.841s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (7cddc281-345a-4ba9-a2d2-8b1396dae9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:54 devstack sudo[115158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 Jun 25 18:33:54 devstack sudo[115158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f332fb-6d18-4d0b-a5d5-d7adaa64a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f332fb-6d18-4d0b-a5d5-d7adaa64a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1391435070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35f0a6c-1f37-4c37-9d60-d725add2d58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:54Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe011f7d-5bfa-455a-bf08-98faaacc72d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe011f7d-5bfa-455a-bf08-98faaacc72d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99aef270-cc09-4462-accc-b7511c734967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99aef270-cc09-4462-accc-b7511c734967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35f0a6c-1f37-4c37-9d60-d725add2d58a', 'volume_name': 'volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410988c0-19e0-4216-b030-131f390460ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410988c0-19e0-4216-b030-131f390460ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b63b161-e051-48fb-87be-49d2ce747945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:54 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume f35f0a6c-1f37-4c37-9d60-d725add2d58a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a', 'volume_size': 1} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:54 devstack sudo[115148]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.828s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:54 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Deleted volume successfully. Jun 25 18:33:54 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-c77621b7-21fb-4704-9b5c-73908e52e161 tempest-VolumeDependencyTests-1882466855 None] Lock "cinder-8e7d04a4-2662-4358-bb80-2109e455b55f-delete_volume" released by "delete_volume" :: held 4.541s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (ed09fc36-7bdf-49b7-8bfe-a367bf0d7f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda10b29-c563-4848-b3a2-b4945285e32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda10b29-c563-4848-b3a2-b4945285e32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-525948079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9e15d2-1876-43f0-9f81-c57df7b84718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:55Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48ea829-00dc-4dfd-a2d4-cac1099b7225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48ea829-00dc-4dfd-a2d4-cac1099b7225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0662c5-4c57-431c-8173-7176f5a66654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0662c5-4c57-431c-8173-7176f5a66654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d9e15d2-1876-43f0-9f81-c57df7b84718', 'volume_name': 'volume-8d9e15d2-1876-43f0-9f81-c57df7b84718', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac406570-be23-4d27-83a7-bbe0c33a22ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac406570-be23-4d27-83a7-bbe0c33a22ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a09d1f-7c9c-440c-ac42-a0399f00dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:55 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume 8d9e15d2-1876-43f0-9f81-c57df7b84718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d9e15d2-1876-43f0-9f81-c57df7b84718', 'volume_size': 1} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:55 devstack sudo[115156]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814" returned: 0 in 1.281s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] <== create_volume: return (3232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.236s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.513s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194693845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665d798f-f972-4929-94da-a66fa75aa973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:53Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Creating volume 665d798f-f972-4929-94da-a66fa75aa973 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:55 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:55 devstack sudo[115199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973 1073741824 Jun 25 18:33:55 devstack sudo[115199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0cfb73-c189-42da-a5f6-8309791e95cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c18211-0aff-43d3-9663-f81f981dd814', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4510f0a5-64e0-44bc-9123-5566c2369128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:55 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume volume-40c18211-0aff-43d3-9663-f81f981dd814 (40c18211-0aff-43d3-9663-f81f981dd814): created successfully Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4510f0a5-64e0-44bc-9123-5566c2369128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (2f452c03-fc38-40f4-8d35-0ce6f337257b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:55 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-4bdd20af-5439-446d-a562-5bd1cfcc234b tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created volume successfully. Jun 25 18:33:55 devstack sudo[115158]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4" returned: 1 in 1.208s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4' failed. Not Retrying. {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:33:55 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:55 devstack sudo[115201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4 Jun 25 18:33:55 devstack sudo[115201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:56 devstack sudo[115201]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-95602830-ac52-4f0e-a028-dbf8d16736e4" returned: 0 in 0.942s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:56 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Lock "cinder-quobyte-95602830-ac52-4f0e-a028-dbf8d16736e4" released by "delete_volume" :: held 4.135s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:56 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Created reservations ['ee83385b-8433-470a-a989-0481c953ac35', 'e9b3bc45-9451-440b-a97a-d5a2a780bdd3', '6756874b-c10c-46f1-84d1-39441b6027ba', '039a1432-a2e7-4ba7-a100-07e88ad537b3'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:33:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:56 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:56 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:56 devstack sudo[115210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:33:56 devstack sudo[115210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:57 devstack sudo[115199]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973 1073741824" returned: 0 in 1.651s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:57 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:57 devstack sudo[115212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973 Jun 25 18:33:57 devstack sudo[115212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:58 devstack sudo[115210]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 1.162s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:33:58 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Deleted volume successfully. Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-a7c769a1-f3e5-4a31-852e-e979e7451e41 tempest-VolumeImageDependencyTests-1620006009 None] Lock "cinder-95602830-ac52-4f0e-a028-dbf8d16736e4-delete_volume" released by "delete_volume" :: held 5.709s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:33:58 devstack sudo[115212]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973" returned: 0 in 0.977s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] <== create_volume: return (2735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.738s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.691s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-417698576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbce442-8766-4652-b002-fc2e8dda8f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:53Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Creating volume ffbce442-8766-4652-b002-fc2e8dda8f16 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:33:58 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc87d80f-3e37-42b2-aa3b-01f0329049e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665d798f-f972-4929-94da-a66fa75aa973', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3064bf5-8531-457a-b304-7c95f94ebea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:33:58 devstack sudo[115216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16 1073741824 Jun 25 18:33:58 devstack sudo[115216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:33:58 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume volume-665d798f-f972-4929-94da-a66fa75aa973 (665d798f-f972-4929-94da-a66fa75aa973): created successfully Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3064bf5-8531-457a-b304-7c95f94ebea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:33:58 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (7d394641-74d1-4ec6-be0d-eac188277579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:33:58 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-fbd94488-2f74-485a-a3c9-4fa7d0234007 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created volume successfully. Jun 25 18:33:59 devstack sudo[115216]: pam_unix(sudo:session): session closed for user root Jun 25 18:33:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16 1073741824" returned: 0 in 1.167s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:33:59 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:33:59 devstack sudo[115222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16 Jun 25 18:33:59 devstack sudo[115222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:00 devstack sudo[115222]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16" returned: 0 in 0.791s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.438s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1391435070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35f0a6c-1f37-4c37-9d60-d725add2d58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:54Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Creating volume f35f0a6c-1f37-4c37-9d60-d725add2d58a {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:34:00 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18533ee4-86bd-41b7-a565-c79ae3137050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbce442-8766-4652-b002-fc2e8dda8f16', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:00 devstack sudo[115225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a 1073741824 Jun 25 18:34:00 devstack sudo[115225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3df8c9-d6e2-4b80-9d9e-75ca65b4663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:00 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume volume-ffbce442-8766-4652-b002-fc2e8dda8f16 (ffbce442-8766-4652-b002-fc2e8dda8f16): created successfully Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3df8c9-d6e2-4b80-9d9e-75ca65b4663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:00 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (02138371-0e93-40fd-8924-14284f648058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:34:00 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-240ebe9d-e7d2-41c8-8dea-92073695cd02 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created volume successfully. Jun 25 18:34:01 devstack sudo[115225]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a 1073741824" returned: 0 in 1.209s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:01 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:01 devstack sudo[115232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a Jun 25 18:34:01 devstack sudo[115232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:34:02 devstack sudo[115232]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Flow 'volume_create_manager' (aa1ad378-62c9-4335-ab88-9a2a8f17ae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da56ed1-ae5b-4cc2-ac12-9419a6df6cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a" returned: 0 in 0.800s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-525948079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9e15d2-1876-43f0-9f81-c57df7b84718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53857e321ab4222809c86a061edff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:33:55Z,use_quota=True,user_id='a9906903beb2428d9a58435dbc6cfcd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Creating volume 8d9e15d2-1876-43f0-9f81-c57df7b84718 {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:34:02 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:02 devstack sudo[115235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 1073741824 Jun 25 18:34:02 devstack sudo[115235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da56ed1-ae5b-4cc2-ac12-9419a6df6cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1086661871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73218428-f469-445d-9681-49d4ae07709c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f00c10552a4e918d5fe3c09d8c9def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:34:02Z,use_quota=True,user_id='a4de30542bc94fd0a866bfef7cc6b060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b81b89f-99ee-47e7-a7d9-ece804a33d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b81b89f-99ee-47e7-a7d9-ece804a33d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5da69c-b92d-4d7e-8ee6-3f18cc8bc070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5da69c-b92d-4d7e-8ee6-3f18cc8bc070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73218428-f469-445d-9681-49d4ae07709c', 'volume_name': 'volume-73218428-f469-445d-9681-49d4ae07709c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5911b499-06c8-4f4e-98d7-1ff43c5d751b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5911b499-06c8-4f4e-98d7-1ff43c5d751b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5090f9df-f064-4da9-87d4-eac5b2dc8690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:02 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Volume 73218428-f469-445d-9681-49d4ae07709c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73218428-f469-445d-9681-49d4ae07709c', 'volume_size': 1} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b63b161-e051-48fb-87be-49d2ce747945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7102d5-b2ca-4c36-8230-e936831ee3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:02 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a (f35f0a6c-1f37-4c37-9d60-d725add2d58a): created successfully Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7102d5-b2ca-4c36-8230-e936831ee3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:02 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (7cddc281-345a-4ba9-a2d2-8b1396dae9f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:34:02 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-1da658dc-beb4-4d5c-a548-2f3361ca3713 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created volume successfully. Jun 25 18:34:03 devstack sudo[115235]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 1073741824" returned: 0 in 0.869s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:03 devstack sudo[115243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 Jun 25 18:34:03 devstack sudo[115243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:03 devstack sudo[115243]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718" returned: 0 in 0.711s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1086661871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73218428-f469-445d-9681-49d4ae07709c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f00c10552a4e918d5fe3c09d8c9def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:34:02Z,use_quota=True,user_id='a4de30542bc94fd0a866bfef7cc6b060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)}" {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Creating volume 73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:34:03 devstack cinder-volume[93767]: INFO cinder.volume.drivers.remotefs [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] casted to osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca Jun 25 18:34:03 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c 1073741824 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:03 devstack sudo[115246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c 1073741824 Jun 25 18:34:03 devstack sudo[115246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a09d1f-7c9c-440c-ac42-a0399f00dc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d9e15d2-1876-43f0-9f81-c57df7b84718', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde82cb0-ec0b-4f1e-a75e-e7712ebdf1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:04 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Volume volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 (8d9e15d2-1876-43f0-9f81-c57df7b84718): created successfully Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde82cb0-ec0b-4f1e-a75e-e7712ebdf1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Flow 'volume_create_manager' (ed09fc36-7bdf-49b7-8bfe-a367bf0d7f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:34:04 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0861395a-f6b3-4658-a064-48367fe87ed0 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created volume successfully. Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-8d9e15d2-1876-43f0-9f81-c57df7b84718-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-8d9e15d2-1876-43f0-9f81-c57df7b84718-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-quobyte-8d9e15d2-1876-43f0-9f81-c57df7b84718" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-8d9e15d2-1876-43f0-9f81-c57df7b84718" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc804ca1-8ad6-4dce-b5c6-4a33bf1a9bf0]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:04 devstack sudo[115248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 Jun 25 18:34:04 devstack sudo[115248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:04 devstack sudo[115246]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c 1073741824" returned: 0 in 0.876s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:04 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:04 devstack sudo[115253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c Jun 25 18:34:04 devstack sudo[115253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:05 devstack sudo[115248]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718" returned: 0 in 0.878s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:05 devstack sudo[115258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718 Jun 25 18:34:05 devstack sudo[115258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:05 devstack sudo[115253]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c" returned: 0 in 0.728s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'} {{(pid=93767) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5090f9df-f064-4da9-87d4-eac5b2dc8690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73218428-f469-445d-9681-49d4ae07709c', 'volume_size': 1}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca91840-9514-4433-b0fb-9bb5627caec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:05 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Volume volume-73218428-f469-445d-9681-49d4ae07709c (73218428-f469-445d-9681-49d4ae07709c): created successfully Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca91840-9514-4433-b0fb-9bb5627caec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Flow 'volume_create_manager' (aa1ad378-62c9-4335-ab88-9a2a8f17ae1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:34:05 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-bc3411d8-8608-468d-8e84-00f39333ef4a tempest-SnapshotDependencyTests-529221122 None] Created volume successfully. Jun 25 18:34:05 devstack sudo[115258]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:05 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-8d9e15d2-1876-43f0-9f81-c57df7b84718" returned: 0 in 0.669s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-8d9e15d2-1876-43f0-9f81-c57df7b84718" released by "delete_volume" :: held 1.598s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created reservations ['3a7db880-7c24-447b-bf1d-78d9084a1f8f', 'e141534b-5f11-4051-80b5-8f16c10435a8', 'ebe89d25-2e61-4b12-a0c0-0d5258ef6e4c', 'f8d04775-2104-4951-b543-fd5341da35fd'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:06 devstack sudo[115262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:34:06 devstack sudo[115262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-f35f0a6c-1f37-4c37-9d60-d725add2d58a-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-f35f0a6c-1f37-4c37-9d60-d725add2d58a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-quobyte-f35f0a6c-1f37-4c37-9d60-d725add2d58a" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-f35f0a6c-1f37-4c37-9d60-d725add2d58a" acquired by "delete_volume" :: waited 0.028s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[471c1669-990f-4a2e-b2b4-42e1cae15fa8]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Creating offline snapshot d99c24fd-8a66-49f8-b506-80e9ce3e4536 of volume 73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ea6071-398a-4287-8237-8e76c0f3e861]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:06 devstack sudo[115262]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:06 devstack sudo[115265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a Jun 25 18:34:06 devstack sudo[115265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.769s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:34:06 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Deleted volume successfully. Jun 25 18:34:06 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-f350a042-ab31-4521-bbb3-a869aca17f60 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-8d9e15d2-1876-43f0-9f81-c57df7b84718-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:07 devstack sudo[115266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c Jun 25 18:34:07 devstack sudo[115266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:07 devstack sudo[115265]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a" returned: 0 in 0.938s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:07 devstack sudo[115275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a Jun 25 18:34:07 devstack sudo[115275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:07 devstack sudo[115266]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c" returned: 0 in 0.953s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:07 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 1G {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:07 devstack sudo[115277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 1G Jun 25 18:34:07 devstack sudo[115277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:08 devstack sudo[115275]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-f35f0a6c-1f37-4c37-9d60-d725add2d58a" returned: 0 in 0.736s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-f35f0a6c-1f37-4c37-9d60-d725add2d58a" released by "delete_volume" :: held 1.752s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created reservations ['c02d7a04-18d7-47c1-b8fd-c5c5270d86a4', '333bf023-e624-44c6-968f-0aae76e7e081', '1aec83cc-3442-44ef-9d06-3117557a3fd3', '595e73d5-bb9f-4c5e-b06b-5bb9dcfabc41'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:08 devstack sudo[115284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:34:08 devstack sudo[115284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:08 devstack sudo[115277]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 1G" returned: 0 in 0.902s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73218428-f469-445d-9681-49d4ae07709c -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:08 devstack sudo[115286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73218428-f469-445d-9681-49d4ae07709c -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 Jun 25 18:34:08 devstack sudo[115286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-ffbce442-8766-4652-b002-fc2e8dda8f16-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-ffbce442-8766-4652-b002-fc2e8dda8f16-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-quobyte-ffbce442-8766-4652-b002-fc2e8dda8f16" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:08 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-ffbce442-8766-4652-b002-fc2e8dda8f16" acquired by "delete_volume" :: waited 0.020s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:09 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc695dcb-f947-439b-a9bc-ae5add2e23b2]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:09 devstack sudo[115288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16 Jun 25 18:34:09 devstack sudo[115288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:09 devstack sudo[115284]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.687s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:09 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:34:09 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Deleted volume successfully. Jun 25 18:34:09 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-ce9f11be-3614-4989-ac68-2446fcf58a46 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-f35f0a6c-1f37-4c37-9d60-d725add2d58a-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:09 devstack sudo[115286]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73218428-f469-445d-9681-49d4ae07709c -F qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536" returned: 0 in 0.824s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:09 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 is being set with open permissions: ugo+rw Jun 25 18:34:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:09 devstack sudo[115294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 Jun 25 18:34:09 devstack sudo[115294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:09 devstack sudo[115288]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16" returned: 0 in 0.773s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:09 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:09 devstack sudo[115299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16 Jun 25 18:34:09 devstack sudo[115299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:10 devstack sudo[115294]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536" returned: 0 in 0.682s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:10 devstack sudo[115302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.info Jun 25 18:34:10 devstack sudo[115302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:10 devstack sudo[115299]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-ffbce442-8766-4652-b002-fc2e8dda8f16" returned: 0 in 0.636s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-ffbce442-8766-4652-b002-fc2e8dda8f16" released by "delete_volume" :: held 1.457s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created reservations ['3ad2d43b-764c-4995-bf7d-fd9d2d9c95a1', '5339bd9f-ed41-40f4-8347-8dcacf43af41', 'b86cf782-d238-4787-80de-0e7b922979bc', '7d8b764c-2fed-41c3-8ab1-187bac1d136b'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:10 devstack sudo[115305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:34:10 devstack sudo[115305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:10 devstack sudo[115302]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.info" returned: 0 in 0.640s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:10 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.info is being set with open permissions: ugo+rw Jun 25 18:34:10 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.info {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:10 devstack sudo[115308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.info Jun 25 18:34:10 devstack sudo[115308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-665d798f-f972-4929-94da-a66fa75aa973-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-665d798f-f972-4929-94da-a66fa75aa973-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-quobyte-665d798f-f972-4929-94da-a66fa75aa973" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:11 devstack sudo[115305]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-665d798f-f972-4929-94da-a66fa75aa973" acquired by "delete_volume" :: waited 0.021s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.685s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:34:11 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Deleted volume successfully. Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f5ef17-0cb8-4175-8b78-1fedf3c824f8]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-084e9cd4-734e-4fba-ba8e-5ac30e741698 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-ffbce442-8766-4652-b002-fc2e8dda8f16-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:11 devstack sudo[115311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973 Jun 25 18:34:11 devstack sudo[115311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:11 devstack sudo[115308]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.info" returned: 0 in 0.681s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:11 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.776s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:11 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9a912e7c-2932-4dce-8796-aff3fde989e2 tempest-SnapshotDependencyTests-529221122 None] Create snapshot completed successfully Jun 25 18:34:12 devstack sudo[115311]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973" returned: 0 in 0.742s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:12 devstack sudo[115317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973 Jun 25 18:34:12 devstack sudo[115317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:12 devstack sudo[115317]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-665d798f-f972-4929-94da-a66fa75aa973" returned: 0 in 0.650s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-665d798f-f972-4929-94da-a66fa75aa973" released by "delete_volume" :: held 1.443s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93767) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created reservations ['0993a7c9-356c-4c47-b68b-41b3409e3f4c', '51ba34b1-434d-43c4-b5dd-eab9bf05f1ec', 'd1227fa2-af12-4eb9-a123-e9f5f35a7c21', 'e5d41b4d-1f48-42ef-a010-cc565327e738'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Flow 'volume_create_manager' (89176cca-a25e-49f4-a06d-139fb342cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d168cd-9e37-4492-9572-80c31f54e855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d168cd-9e37-4492-9572-80c31f54e855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df8092a-6128-421d-94d0-125131a40652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f00c10552a4e918d5fe3c09d8c9def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d99c24fd-8a66-49f8-b506-80e9ce3e4536,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:34:13Z,use_quota=True,user_id='a4de30542bc94fd0a866bfef7cc6b060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64665831-7530-4227-9677-f0f3cfce07ed),volume_type_id=64665831-7530-4227-9677-f0f3cfce07ed)' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14b1857-1c89-4c72-a63e-4f047bb3909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14b1857-1c89-4c72-a63e-4f047bb3909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e00bd5-abfc-483b-bdc1-574ad7f7c975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e00bd5-abfc-483b-bdc1-574ad7f7c975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0df8092a-6128-421d-94d0-125131a40652', 'volume_name': 'volume-0df8092a-6128-421d-94d0-125131a40652', 'volume_size': 1, 'snapshot_id': 'd99c24fd-8a66-49f8-b506-80e9ce3e4536'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f623c37-7091-47d1-966e-f20da06ba3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f623c37-7091-47d1-966e-f20da06ba3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46adce9-b0f3-498a-b464-2edfd96d5c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:12 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Volume 0df8092a-6128-421d-94d0-125131a40652: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0df8092a-6128-421d-94d0-125131a40652', 'volume_size': 1, 'snapshot_id': 'd99c24fd-8a66-49f8-b506-80e9ce3e4536'} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "cinder-quobyte-d99c24fd-8a66-49f8-b506-80e9ce3e4536-0df8092a-6128-421d-94d0-125131a40652" by "_create_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-d99c24fd-8a66-49f8-b506-80e9ce3e4536-0df8092a-6128-421d-94d0-125131a40652" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Creating volume 0df8092a-6128-421d-94d0-125131a40652 from snapshot d99c24fd-8a66-49f8-b506-80e9ce3e4536 {{(pid=93767) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Selected osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca as target Quobyte volume. {{(pid=93767) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "cinder-quobyte-0df8092a-6128-421d-94d0-125131a40652" by "_copy_volume_from_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-0df8092a-6128-421d-94d0-125131a40652" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] snapshot: d99c24fd-8a66-49f8-b506-80e9ce3e4536, volume: 0df8092a-6128-421d-94d0-125131a40652, {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:34:12 devstack sudo[115320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:34:12 devstack sudo[115320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20a06f0-5062-4c43-89d9-eb36e8fd8cc5]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:12 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:13 devstack sudo[115322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 Jun 25 18:34:13 devstack sudo[115322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-40c18211-0aff-43d3-9663-f81f981dd814-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-40c18211-0aff-43d3-9663-f81f981dd814-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-quobyte-40c18211-0aff-43d3-9663-f81f981dd814" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-40c18211-0aff-43d3-9663-f81f981dd814" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[5535cb6d-a78c-41ca-94b6-9f658d0ae5f9]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:13 devstack sudo[115320]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.701s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:34:13 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Deleted volume successfully. Jun 25 18:34:13 devstack sudo[115326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814 Jun 25 18:34:13 devstack sudo[115326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-fe52888a-bae5-45cf-bd44-c4fa17bb139c tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-665d798f-f972-4929-94da-a66fa75aa973-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:13 devstack sudo[115322]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536" returned: 0 in 0.797s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73218428-f469-445d-9681-49d4ae07709c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Creating direct copy from snapshot {{(pid=93767) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb878a6-e203-419b-a142-0563c215ff96]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:13 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:13 devstack sudo[115331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c Jun 25 18:34:13 devstack sudo[115331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:14 devstack sudo[115326]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814" returned: 0 in 0.776s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:14 devstack sudo[115342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814 Jun 25 18:34:14 devstack sudo[115342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:14 devstack sudo[115331]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c" returned: 0 in 0.745s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:14 devstack cinder-volume[93767]: DEBUG cinder.utils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Path /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 not found in is_blk_device check {{(pid=93767) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:34:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:14 devstack sudo[115347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 Jun 25 18:34:14 devstack sudo[115347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:14 devstack sudo[115342]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:14 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-40c18211-0aff-43d3-9663-f81f981dd814" returned: 0 in 0.646s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:14 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-40c18211-0aff-43d3-9663-f81f981dd814" released by "delete_volume" :: held 1.466s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:14 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created reservations ['a8eb2171-c185-409f-872e-a5014d549e7b', '7d93064d-4b6e-42d9-bd74-8d2f8dd3af02', 'ea6f9b38-2a2c-411e-b940-2a908f6b7ba2', '78a5aade-ed9a-448a-8e37-c2c3a42406cf'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:15 devstack sudo[115350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:34:15 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-b23b41b7-e4b7-4e1a-b115-b9da97915089-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-b23b41b7-e4b7-4e1a-b115-b9da97915089-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:15 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.813s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:34:15 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Deleted volume successfully. Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "cinder-quobyte-b23b41b7-e4b7-4e1a-b115-b9da97915089" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:15 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-b23b41b7-e4b7-4e1a-b115-b9da97915089" acquired by "delete_volume" :: waited 0.051s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:16 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-3166bada-f4ea-454e-9e45-fbdf393179c2 tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-40c18211-0aff-43d3-9663-f81f981dd814-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:16 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bb5762-c2af-4011-8e36-811d8a3c36dc]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:16 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:16 devstack sudo[115363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 Jun 25 18:34:16 devstack sudo[115363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:17 devstack sudo[115363]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089" returned: 0 in 1.914s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:17 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:18 devstack sudo[115369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089 Jun 25 18:34:18 devstack sudo[115369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:19 devstack sudo[115369]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-b23b41b7-e4b7-4e1a-b115-b9da97915089" returned: 0 in 1.292s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-quobyte-b23b41b7-e4b7-4e1a-b115-b9da97915089" released by "delete_volume" :: held 3.323s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Created reservations ['f8b4f577-f0f4-4c9b-bf6a-c0ea3f12f7ad', '7062d71d-68eb-4f78-b0ea-1548c67e7094', '6a534d6c-e9e5-416c-b1e7-900794fb0ccf', 'a54ba3b9-7083-4f3a-b1a5-47328015c8cb'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:34:19 devstack sudo[115347]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652" returned: 0 in 4.821s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26e380d-e08a-42cb-ab47-8df4792fb200]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:19 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:19 devstack sudo[115373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:34:19 devstack sudo[115373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:19 devstack sudo[115372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c Jun 25 18:34:19 devstack sudo[115372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:20 devstack sudo[115373]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.609s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:34:20 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Deleted volume successfully. Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8dd74ec8-fe9d-45c6-9365-966925a8196f tempest-CreateVolumesFromSourceVolumeTest-1752217998 None] Lock "cinder-b23b41b7-e4b7-4e1a-b115-b9da97915089-delete_volume" released by "delete_volume" :: held 4.280s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:20 devstack sudo[115372]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c" returned: 0 in 0.910s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG cinder.image.image_utils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 {{(pid=93767) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:34:20 devstack cinder-volume[93767]: INFO cinder.image.image_utils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Converted 1024.00 MB image at 212.36 MB/s Jun 25 18:34:20 devstack cinder-volume[93767]: WARNING cinder.volume.drivers.remotefs [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 is being set with open permissions: ugo+rw Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:20 devstack sudo[115380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 Jun 25 18:34:20 devstack sudo[115380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:20 devstack sudo[115380]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652" returned: 0 in 0.645s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-0df8092a-6128-421d-94d0-125131a40652" released by "_copy_volume_from_snapshot" :: held 8.014s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-d99c24fd-8a66-49f8-b506-80e9ce3e4536-0df8092a-6128-421d-94d0-125131a40652" released by "_create_volume_from_snapshot" :: held 8.070s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.095s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46adce9-b0f3-498a-b464-2edfd96d5c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df8092a-6128-421d-94d0-125131a40652', 'volume_size': 1, 'snapshot_id': 'd99c24fd-8a66-49f8-b506-80e9ce3e4536'}' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24805a2a-aae9-429a-8367-6802669cb8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:34:20 devstack cinder-volume[93767]: INFO cinder.volume.flows.manager.create_volume [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Volume volume-0df8092a-6128-421d-94d0-125131a40652 (0df8092a-6128-421d-94d0-125131a40652): created successfully Jun 25 18:34:20 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24805a2a-aae9-429a-8367-6802669cb8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93767) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Flow 'volume_create_manager' (89176cca-a25e-49f4-a06d-139fb342cfac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93767) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:34:21 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-8f22035b-73f0-4bdd-bcae-092e6bb0ce20 tempest-SnapshotDependencyTests-529221122 None] Created volume successfully. Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "cinder-d99c24fd-8a66-49f8-b506-80e9ce3e4536-delete_snapshot" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-d99c24fd-8a66-49f8-b506-80e9ce3e4536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "cinder-quobyte-73218428-f469-445d-9681-49d4ae07709c" by "delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-73218428-f469-445d-9681-49d4ae07709c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "cinder-quobyte-d99c24fd-8a66-49f8-b506-80e9ce3e4536" by "_delete_snapshot" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-d99c24fd-8a66-49f8-b506-80e9ce3e4536" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Deleting offline snapshot d99c24fd-8a66-49f8-b506-80e9ce3e4536 of volume 73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] snapshot_file for this snap is: volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 {{(pid=93767) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a0d794-a8b2-4691-9ab4-f5b11f396a5c]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:21 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:21 devstack sudo[115383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 Jun 25 18:34:21 devstack sudo[115383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:22 devstack sudo[115383]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536" returned: 0 in 0.725s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:22 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.remotefs [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73218428-f469-445d-9681-49d4ae07709c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93767) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:34:22 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d32ef-359e-48a2-ba47-d41b1a7b0880]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:22 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:22 devstack sudo[115389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c Jun 25 18:34:22 devstack sudo[115389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:23 devstack sudo[115389]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c" returned: 0 in 0.732s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:23 devstack sudo[115395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 Jun 25 18:34:23 devstack sudo[115395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:23 devstack sudo[115395]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536" returned: 0 in 0.691s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:23 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:23 devstack sudo[115400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536 Jun 25 18:34:23 devstack sudo[115400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:24 devstack sudo[115400]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c.d99c24fd-8a66-49f8-b506-80e9ce3e4536" returned: 0 in 0.615s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-d99c24fd-8a66-49f8-b506-80e9ce3e4536" released by "_delete_snapshot" :: held 2.861s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-73218428-f469-445d-9681-49d4ae07709c" released by "delete_snapshot" :: held 2.884s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Created reservations ['ed8995cd-93bc-4fc4-9c6e-5bef0fc63152', '0d3f89d1-ff25-417e-896b-4f4519f773bf', '38518e29-f8e5-4aab-a500-bc4365fdddea', '1d8a9949-b27f-4d4a-b374-5ad5dc582b62'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:34:24 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Delete snapshot completed successfully. Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-0c1692c2-93f0-4845-8035-f267f677ccb6 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-d99c24fd-8a66-49f8-b506-80e9ce3e4536-delete_snapshot" released by "delete_snapshot" :: held 3.016s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "cinder-73218428-f469-445d-9681-49d4ae07709c-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-73218428-f469-445d-9681-49d4ae07709c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "cinder-quobyte-73218428-f469-445d-9681-49d4ae07709c" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-73218428-f469-445d-9681-49d4ae07709c" acquired by "delete_volume" :: waited 0.018s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6069b8-3776-4026-8437-b2d56c1712b2]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:24 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:24 devstack sudo[115403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c Jun 25 18:34:24 devstack sudo[115403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:25 devstack sudo[115403]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c" returned: 0 in 0.756s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:25 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:25 devstack sudo[115410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c Jun 25 18:34:25 devstack sudo[115410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:26 devstack sudo[115410]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-73218428-f469-445d-9681-49d4ae07709c" returned: 0 in 0.638s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-73218428-f469-445d-9681-49d4ae07709c" released by "delete_volume" :: held 1.450s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Created reservations ['b6e94c6d-fdce-4fa7-97c2-11632089d62a', 'd7b7cd52-393a-4e64-8ef0-15ffe278e497', '7cc10c14-2eaa-4271-b7db-66bcddd4c561', '36b41b64-95db-476a-adec-4d0dca25fb1e'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:26 devstack sudo[115413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:34:26 devstack sudo[115413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "cinder-0df8092a-6128-421d-94d0-125131a40652-delete_volume" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:26 devstack sudo[115413]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.608s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:34:26 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Deleted volume successfully. Jun 25 18:34:26 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-0df8092a-6128-421d-94d0-125131a40652-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-9399bbe3-0770-4615-bbbe-91550cc52f37 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-73218428-f469-445d-9681-49d4ae07709c-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "cinder-quobyte-0df8092a-6128-421d-94d0-125131a40652" by "delete_volume" {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:34:27 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-0df8092a-6128-421d-94d0-125131a40652" acquired by "delete_volume" :: waited 0.013s {{(pid=93767) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:34:27 devstack cinder-volume[93767]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac30c639-a2d4-4a41-b510-9a61364b95d4]: (4, 'qcow2') {{(pid=94756) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:34:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:27 devstack sudo[115416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 Jun 25 18:34:27 devstack sudo[115416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:27 devstack sudo[115416]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652" returned: 0 in 0.738s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:27 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:27 devstack sudo[115421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652 Jun 25 18:34:27 devstack sudo[115421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:28 devstack sudo[115421]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5/volume-0df8092a-6128-421d-94d0-125131a40652" returned: 0 in 0.630s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:28 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-quobyte-0df8092a-6128-421d-94d0-125131a40652" released by "delete_volume" :: held 1.405s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:28 devstack cinder-volume[93767]: DEBUG cinder.quota [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Created reservations ['5464dd6a-7ba4-40cd-825e-0d79739810a2', 'cb17cea6-62fd-4ae8-8c85-01f0db9ec2fe', '6e2736e7-23f5-49a2-924c-3a7bc3652fa2', 'e88069ca-ae38-4e5e-9f48-03c9f0bed28d'] {{(pid=93767) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:34:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:28 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:28 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:28 devstack sudo[115424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:34:28 devstack sudo[115424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:29 devstack sudo[115424]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:29 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.674s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:29 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:34:29 devstack cinder-volume[93767]: INFO cinder.volume.manager [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Deleted volume successfully. Jun 25 18:34:29 devstack cinder-volume[93767]: DEBUG cinder.coordination [None req-58f0e24a-2d5d-46d5-8576-4d033ca338e2 tempest-SnapshotDependencyTests-529221122 None] Lock "cinder-0df8092a-6128-421d-94d0-125131a40652-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=93767) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:34:38 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:SELECT=94,cinder:INSERT=34,cinder:UPDATE=121,cinder:DELETE=12 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:34:39 devstack cinder-volume[93767]: DEBUG dbcounter [-] [93767] Writing DB stats cinder:UPDATE=135,cinder:SELECT=88,cinder:INSERT=34,cinder:DELETE=9 {{(pid=93767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:34:40 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:34:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:34:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:34:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca': None} {{(pid=93767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:34:40 devstack cinder-volume[93767]: DEBUG cinder.volume.drivers.quobyte [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-447941e9-5cc4-49ed-ae47-6ca4ab7cd8ca'] {{(pid=93767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:34:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.lockutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:34:40 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:34:40 devstack sudo[115459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5 Jun 25 18:34:40 devstack sudo[115459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:34:41 devstack sudo[115459]: pam_unix(sudo:session): session closed for user root Jun 25 18:34:41 devstack cinder-volume[93767]: DEBUG oslo_concurrency.processutils [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8c8b7923f2fdf1ac454d78a50026ec5" returned: 0 in 0.623s {{(pid=93767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:34:41 devstack cinder-volume[93767]: DEBUG cinder.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Notifying Schedulers of capabilities ... {{(pid=93767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:34:41 devstack cinder-volume[93767]: DEBUG oslo_service.periodic_task [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] Running periodic task VolumeManager._thread_info {{(pid=93767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:34:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread count: 28 {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6104}} Jun 25 18:34:41 devstack cinder-volume[93767]: DEBUG cinder.volume.manager [None req-4ce97ab3-30fc-4193-a833-762a4f77b996 None None] thread info: [<_MainThread(MainThread, started 126924787511424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:6105}}